Tumor progression is characterized by an incremental stiffening of the tissue. The importance of tissue rigidity to cancer is appreciated, yet the contribution of specific tissue elements to tumor stiffening and their physiological significance remains unclear. We performed high-resolution atomic force microscopy indentation in live and snap-frozen fluorescently labeled mammary tissues to explore the origin of the tissue stiffening associated with mammary tumor development in PyMT mice. The tumor epithelium, the tumor-associated vasculature and the extracellular matrix all contributed to mammary gland stiffening as it transitioned from normal to invasive carcinoma. Consistent with the concept that extracellular matrix stiffness modifies cell tension, we found that isolated transformed mammary epithelial cells were intrinsically stiffer than their normal counterparts but that the malignant epithelium in situ was far stiffer than isolated breast tumor cells. Moreover, using an in situ vitrification approach, we determined that the extracellular matrix adjacent to the epithelium progressively stiffened as tissue evolved from normal through benign to an invasive state. Importantly, we also noted that there was significant mechanical heterogeneity within the transformed tissue both in the epithelium and the tumor-associated neovasculature. The vascular bed within the tumor core was substantially stiffer than the large patent vessels at the invasive front that are surrounded by the stiffest extracellular matrix. These findings clarify the contribution of individual mammary gland tissue elements to the altered biomechanical landscape of cancerous tissues and emphasize the importance of studying cancer cell evolution under conditions that preserve native interactions.