Levert was born in Bessemer, Alabama, but was raised in Canton, Ohio, where he moved at the age of 6. He attended church regularly and eventually joined the church choir. As Levert continued singing into his teenage years, he became a recognized voice in the church choir, sang in school plays and performed regularly on a gospel radio show.

Whilst at high school he teamed up with classmates Walter Williams, William Powell, Bobby Massey and Bill Isles to form a group called the Triumphs. The Triumphs played locally in Canton opening for different acts, playing 'sock hops'. They traveled to Cincinnati to canvas King Records whose President Sid Nathan changed their name to The Mascots and signed them to his label. The Mascots’ popularity grew as their music was broadcast on Cleveland radio stations.

In 1969, The O’Jays signed with Philadelphia International Records where they began to release records under the new label. The O'Jays later signed with EMI-Manhattan Records and Levert and Williams began co-writing and producing their own tracks. Their EMI debut album, "Let Me Touch You", went to number three R&B and included "Lovin' You," which became a number one R&B hit in the summer of 1987.