I had issues with Fungi fruiting in pine bark bases mixes.
Basically the pine bark was not composted before the mix was made, this allowed stage 1 organisms to colonise /dominate the mix.
Properly composted pine bark should be at a later stage, favouring different organisms.
You see yellow fruiting bodies, but underneath there is a mass of hyphae. Sometimes a low %, sometimes a large %.
Some of my pots were dominated by the fungi, lots of pinkish threads and a distinct smell.
Overall there is a balance between protection by the wood rotting fungi from other pathogenic fungi and competition for nutrients with your plant.
Also wood rotting fungi will break down the organic matter in the mix, shrinking the mix and changing the structure.
The issue went on for several years in those pots until the fungal balance changed, and the pot mix went to another stage.
For pot mixes based on pine bark, peat, coir etc there is a benefit to some slight composting activity in the pots, as it promotes healthy microorganisms and disease suppression.
If the hyphae become too dominate they can negatively affect live plant roots.
Using liquid feeds like compost tea, seaweed, fish fertiliser that promote other organisms may restore the microbe balance.
Topdressing with organic fertilisers that need to be broken down may also benefit.
If your plants are growing normally, and not showing signs of slower growth or stagnation, it should be ok.
Also as you say, environmental conditions are a major trigger to fungal activity.