The reason they are so tart is because the source of tartness is in the plum fruit itself.
The source of the sourness in the plum pulp is citric acid and malic acid, two things that remain in the pulp even after it has been salted. Even after being pickled in salt, these acids remain in the umeboshi. This is why umeboshi is sour.