Groundwater resources in the semi-arid regions of southern India are under immense pressure due to large-scale groundwater abstraction vis-a-vis meager rainfall recharge. Therefore, understanding and evaluating the spatial distribution of groundwater is essential for viable utilization of the resource. Here, we assess groundwater potential at the watershed scale, in a semi-arid environment with crystalline aquifer system without a perennial surface water source using remote sensing, geophysical, and GIS-based integrated multi-parameter approach. GIS-based weighed overlay analysis is performed with input parameters, viz., geology, geomorphology, lineament density, land use, soil, drainage density, slope, and aquifer thickness. The watershed is categorized into four zones, namely, very good (GWP4), good (GWP3), moderate (GWP2), and low (GWP1) in terms of groundwater potential. Overall, similar to 70% of the study area falls under moderate to low groundwater potential, indicating a serious threat to the future availability of the resource. Therefore, serious measures are required for maintaining aquifer resilience in this over-exploited aquifer (e.g., restricting groundwater withdrawal from GWP1 and GWP2 zones). Further, as the aquifer is under tremendous anthropogenic pressure, rainwater harvesting and artificial recharge during monsoon are advocated for sustainable aquifer management. Due to the direct dependence of crop production vis-a-vis farmer economy on groundwater, this study is an important step towards sustainable groundwater management and can be applied in diverse hydrological terrains.