Fix curtain rod brackets

Tried to DIY a curtain rod install with a friend last year. The brackets are semi-hanging off the wall and could fall off at any moment. We drilled holes and put plugs in, then put the screws into the plugs - the thing is, there's 3 sets of screw holes and we put one of them into the larger hole instead of the smaller one, hence why it doesn't hold up well.. P.S for some reason the photo upload may have auto-rotated!