Most of structural failures are because of break in consisting materials. Beginning of these breaks is with crack which extension of them is a serious threat to behavior of structure, so the methods of distinguishing and showing of cracks are most important subjects which are being investigated. In this article, a new smart portable mechanical system to detect damage in beam structures form using fuzzy-genetic algorithm is introduced. Acceleration-time history of the three point of beam is obtained. The signals are then decomposed into smaller components using new EMD (Empirical Mode Decomposition) method with every IMF containing a specific range of the frequency. The dominate frequencies of the structure are obtained from these IMFs using Short-Time Fourier transform. Subsequently, a new method of damage detection in simply supported beams is introduced based on fuzzy-genetic algorithm. The new method is capable of identifying the location and severity of the damage. This algorithm is developed to detect the location and severity of the damage along the beam, which can detect the damage location and severity based on the pattern of beam frequency variations between undamaged and damaged states.