you can pay for the Nintendo Switch, its totally above-board! You can buy most of the old retro games in their store.
The Chinese handhelds are cheap because they are absolutely violating copyright. You can't play ROMs without the BIOS of the original hardware, which is illegal to copy.