Beta diversity - the variation in species composition among spatially discrete communities - and sampling grain - the size of samples being compared - may alter our perspectives of diversity within and between landscapes before and after agricultural conversion. Such assumptions are usually based on point comparisons, which do not accurately capture actual differences in total diversity. Beta diversity is often not rigorously examined. We investigated the beta diversity of ground-foraging ant communities in fragmented oil palm and forest landscapes in Sabah, Malaysia, using diversity metrics transformed from Hill number equivalents to remove dependences on alpha diversity. We compared the beta diversities of oil palm and forest, across three hierarchically nested sampling grains. We found that oil palm and forest communities had a greater percentage of total shared species when larger samples were compared. Across all grains and disregarding relative abundances, there was higher beta diversity of all species among forest communities. However, there were higher beta diversities of common and very abundant (dominant) species in oil palm as compared to forests. Differences in beta diversities between oil palm and forest were greatest at the largest sampling grain. Larger sampling grains in oil palm may generate bigger species pools, increasing the probability of shared species with forest samples. Greater beta diversity of all species in forest may be attributed to rare species. Oil palm communities may be more heterogeneous in common and dominant species because of variable community assembly events. Rare and also common species are better captured at larger grains, boosting differences in beta diversity between larger samples of forest and oil palm communities. Although agricultural landscapes support a lower total diversity than natural forests, diversity especially of abundant species is still important for maintaining ecosystem stability. Diversity in agricultural landscapes may be greater than expected when beta diversity is accounted for at large spatial scales.