I have setup the following media sizes:

Miniature size: 240x180
Preview size: 480x360
Normal size: 640x480

And selected the options:
Best image crop
Force image aspect


But images that are smaller than de miniature size 240x180 aren't cropped at all which make the layout destroyed and not all the images have the same size.

Also the images that are not horizontal but vertical get cropped and missing the top and bottom of the image.
A image with a size 6000x4000px is going fine but a image with the size 4000x6000 get chopped of at the top and the bottom.

And if I remove the option "best image crop" then all my images have a different size and for the layout that is not viewing correct.

What are the best settings so images are converted the right way? Or how to solve this issue?

@vansebas
Deselect both options, they even cannot work together so it's useless to have them both enabled.
I saw some complaints regarding best crop feature already, but was not able to reproduce it.

Wow I feel stupid 
Didn't tried this option and this option was the one who solved the issue.

Thanks for the help!