Looks like as long as the declared value is less than USD$800 and it's for personal use (not re-sale) you shouldn't have to pay duty ...
https://www.cbp.gov/trade/basic-import-export/internet-purchases
I've never bought anything from Japan, only Canada and definitely under $800 and have never had issues with customs or duty. But I suppose that could be due to NAFTA or something ...