Approximations and adaptability of neural networks

Given a neural network that approximates a given function, which describes some physical phenomenon. If the physical constraints and hence the given function change, neural networks must adapt to the physical world by changing their architecture. The new architecture may have more neurons, so the adaptable neural networks need this learning abilities that are not in traditional design.