I haven’t tried exactly what you’re doing, but I believe that WordPress applies some CSS (maybe JS too) to the backend to make videos responsive, but they were not originally applying it to the frontend (that may have changed).
You might try dynamically adding those classes to your embeds with the Data API and see if that resolves the situation.