The fleshy tissue produced outside the "core" comes from the hypanthium, while tissue inside the core comes from the carpels.

[Incidentally, that white spongy tissue inside the rind is called the 'albedo'. That same word also refers to the fraction of light reflected from a body or surface. A good example of how one word can have two totally different meanings!]