Yes, it will likely affect the growth rate and thus the time it takes to fruit. Seedling fruit trees naturally go through a juvenile period where they grow vegetatively and likely won’t fruit until they reach a certain age or size or both.
If you graft mature scion onto a small seedling, there is a good chance the grafted branch will fruit significantly earlier than the non grafted main trunk of the seedling.
When a tree holds fruit, it pulls a significant amount of energy from the main tree and the smaller the seedling tree, the more it will slow down the growth of the tree.
You may want to let your seedling grow much larger before grafting mature scions onto it.
If you have a large and mature tree of whatever species you want to test out, consider grafting multiple seedling selections on their large and established tree. Because the tree is large and established, the grafted seedlings will grow faster and may fruit a bit sooner.
Simon