Infra audit: add single-GPU routing and best-fit worker packing#1810

luke-lombardi wants to merge 6 commits into

mainbeam-cloud/beta9:mainfrom

ll/infra-auditbeam-cloud/beta9:ll/infra-auditCopy head branch name to clipboard