3D-culture systems have advanced cancer modeling by reflecting physiological characteristics of in-vivo tissues, but our understanding of functional intratumor heterogeneity including visual phenotypes and underlying gene expression is still limited. Transcriptional heterogeneity can be dissected by single-cell RNA-sequencing, but these technologies suffer from low RNA-input and fail to directly correlate gene expression with contextual cellular phenotypes. Here we present ‘pheno-seq’ for integrated high-throughput imaging and transcriptomic profiling of clonal tumor spheroids derived from 3D models of breast and colorectal cancer. Specifically, we identify characteristic expression signatures that are associated with heterogeneous invasive and proliferative behavior including a rare cell subtype. Furthermore, we identify functionally relevant transcriptional regulators missed by single-cell RNA-seq, link visual phenotypes defined by heterogenous expression to inhibitor response and infer single-cell regulatory states by deconvolution. We anticipate that directly linking molecular features with patho-phenotypes of cancer cells will improve the understanding of intratumor heterogeneity and consequently prove to be useful for translational research.