The helicopter, a CH-53, came down in the Okinawa region near the village of Takamura Takae on Wednesday morning, local media reported.
Images taken from the scene showed the aircraft engulfed in a fireball with thick black smoke pouring into the sky.
It is not yet known if anyone was hurt in the crash.
It came hours after the US sent six military aircraft including two supersonic bombers to the Korean peninsula in a show of force.
The bombers from Guam staged a simulated air-to-ground missile firing drill with two South Korean F-15K fighters over the East Sea.

vCard.red is a free platform for creating a mobile-friendly digital business cards. You can easily create a vCard and generate a QR code for it, allowing others to scan and save your contact details instantly.
The platform allows you to display contact information, social media links, services, and products all in one shareable link. Optional features include appointment scheduling, WhatsApp-based storefronts, media galleries, and custom design options.
Japan also sent two military aircraft as tensions mount the North could trigger World War 3.
This story is being updated.