The main difference between ordinary double-sided PCBs and multilayer PCBs lies in their structure: double-sided boards have wiring layers on both sides of a single medium layer, while multilayer boards contain multiple conductive layers separated by dielectric layers, allowing for complex connections and enhanced functionality.