This study focused on the influence of ultramafic terrains on soil and surface water environmental chemistry in Peninsular Malaysia and in the State of Sabah also in Malaysia. The sampling included 27 soils from four isolated outcrops at Cheroh, Bentong, Bukit Rokan, and Petasih from Peninsular Malaysia and sites near Ranau in Sabah. Water samples were also collected from rivers and subsurface waters interacting with the ultramafic bodies in these study sites. Physico-chemical parameters (including pH, EC, CEC) as well as the concentration of major and trace elements were measured in these soils and waters. Geochemical indices (geoaccumulation index, enrichment factor, and concentration factor) were calculated. Al2O3 and Fe2O3 had relatively high concentrations in the samples. A depletion in MgO, CaO, and Na2O was observed as a result of leaching in tropical climate, and in relation to weathering and pedogenesis processes. Chromium, Ni, and Co were enriched and confirmed by the significant values obtained for Igeo, EF, and CF, which correspond to the extreme levels of contamination for Cr and high to moderate levels of contamination for Ni and Co. The concentrations of Cr, Ni, and Co in surface waters did not reflect the local geochemistry and were within the permissible ranges according to WHO and INWQS standards. Subsurface waters were strongly enriched by these elements and exceeded these standards. The association between Cr and Ni was confirmed by factor analysis. The unexpected enrichment of Cu in an isolated component can be explained by localized mineralization in Sabah.