It is believed that the remains are of Native Americans who lived in the region over 300 years ago.
The Gabrielino band of Mission Indians of San Gabriel, lays claim to the site, stating it is the location of an ancient indian village, established there long before Los Angeles even existed.
Local news from across Southern California
A spokesperson for the group said they are frustrated, because they only received word of the find on Tuesday, and they say the current property owners are keeping them away from the remains.
"We are mad that our ancestors on this day are being desecrated. Taken out of their ancient burials, and placed in a trailer," states Andrew Salas, Tribal Chair Person for the Gabrielino Band of Mission Indians of San Gabriel.
The tribe want's the remains to stay exactly where they are, and they say it's sad to build a center to celebrate one culture, by destroying another.