Conventional in vitro aggregation assays often involve tagging with extrinsic fluorophores, which can interfere with aggregation. We propose the use of intrinsic amyloid fluorescence lifetime probed using two-photon excitation and represented by model-free phasor plots as a label-free assay to characterize the amyloid structure. Intrinsic amyloid fluorescence arises from the structured packing of β-sheets in amyloids and is independent of aromatic-based fluorescence. We show that different amyloids [i.e., α-Synuclein (αS), β-Lactoglobulin (βLG), and TasA] and different polymorphic populations of αS (induced by aggregation in salt-free and salt buffers mimicking the intra-/extracellular environments) can be differentiated by their unique fluorescence lifetimes. Moreover, we observe that disaggregation of the preformed fibrils of αS and βLG leads to increased fluorescence lifetimes, distinct from those of their fibrillar counterparts. Our assay presents a medium-throughput method for rapid classification of amyloids and their polymorphs (the latter of which recent studies have shown lead to different disease pathologies) and for testing small-molecule inhibitory compounds.