When you use a Riemann sum to approximate the area under the curve, you're just sketching rectangles under the curve, taking the area of each rectangle, and then adding the areas together. When you use midpoints, it means that you draw the rectangles such that the midpoints of their top edges touch the curve.