In a large pot, bring water to a boil and add the halved baby potatoes. Boil for about 10 minutes, until tender but not falling apart. Drain and set aside.
In a large skillet, heat 2 tablespoons of olive oil over medium-high heat. Once hot, add the boiled potatoes and season with salt, pepper, and paprika. Cook until crispy and golden brown, stirring occasionally, about 5-7 minutes. Remove the potatoes from the skillet and set aside.
In the same skillet, add the remaining 2 tablespoons of olive oil. Add the steak bites in a single layer, cooking in batches if necessary to avoid overcrowding. Sear the steak for 2-3 minutes on each side until browned but still medium rare, adjusting the cooking time according to your preference.
Lower the heat and add the butter and minced garlic to the skillet with the steak. Cook for another 1-2 minutes, allowing the garlic to become fragrant and the butter to coat the steak.
Return the crispy potatoes to the skillet. Toss gently to combine and coat everything with the garlic butter.
Remove from heat, garnish with fresh chopped parsley, and serve immediately.