Unicellular cyanobacteria are ubiquitous photoautotrophic microbes that contribute substantially to global primary production. Picocyanobacteria such as Synechococcus and Prochlorococcus depend on chlorophyll a-binding protein complexes to capture light energy. In addition, Synechococcus has accessory pigments organized into phycobilisomes, and Prochlorococcus contains chlorophyll b. Across a surface water transect spanning the sparsely studied tropical Indian Ocean, we examined Synechococcus and Prochlorococcus occurrence, taxonomy and habitat preference in an evolutionary context. Shotgun sequencing of size fractionated microbial communities from 0.1 μm to 20 μm and subsequent phylogenetic analysis indicated that cyanobacteria account for up to 15% of annotated reads, with the genera Prochlorococcus and Synechococcus comprising 90% of the cyanobacterial reads, even in the largest size fraction (3.0-20 mm). Phylogenetic analyses of cyanobacterial light-harvesting genes (chl-binding pcb/isiA, allophycocyanin (apcAB), phycocyanin (cpcAB) and phycoerythin (cpeAB)) mostly identified picocyanobacteria clades comprised of overlapping sequences obtained from Indian Ocean, Atlantic and/or Pacific Oceans samples. Habitat reconstructions coupled with phylogenetic analysis of the Indian Ocean samples suggested that large Synechococcus-like ancestors in coastal waters expanded their ecological niche towards open oligotrophic waters in the Indian Ocean through lineage diversification and associated streamlining of genomes (e.g. loss of phycobilisomes and acquisition of Chl b); resulting in contemporary small celled Prochlorococcus. Comparative metagenomic analysis with picocyanobacteria populations in other oceans suggests that this evolutionary scenario may be globally important.