Can it be said that someone who only has casual sex has a better sex life than someone who’s only slept with one partner all his life?

Define “better.”

While you’re at it, how would you specify “better,” considering the wide range of human possibilities?

You are the only one who can make that determination for yourself. Everyone else gets to decide what their ideal is, too.

Your question is impossible to answer.