To the OP... consider something like a 1-1.5 ton ductless mini split for your upstairs and a 2 ton split system with AHU for your existing downstairs ductwork. Assuming your ductwork is reasonable.
Check for holes or breaks in the ducts along the runs, sharp turns that would restrict airflow, and duct leakage where the ducts connect to your AHU, registers, or where the branch ducts connect to the trunk duct. And mastic/duct tape them sumbitches up. If you have sharp bends that restrict airflow, consider replacing that section. Help it help you.