Way back at the dawn of automatic phone services, a lot of switches didn't provide a dial tone at all. You just picked up and dialled. However, as things got bigger and busier they started to have to share equipment a lot more between growing numbers of customers and you couldn't guarantee that you'd pick up a phone and just be able to dial, so dial tones were introduced to give people an indication that the system was ready to receive digits.
If you go back to electromechanical switching days, you picked up the phone and got silence and clicks as line finder systems went hunting for an available slot on equipment - which could have been directly into a stepping switch, or a register which received digits into what was effectively an analogue, relay based computer in crossbars and other 'common control' switches. Then when a free stepper switch or a register was found, you got a dial tone.
A step-by-step switch (Strowger) typically move as each digit is dialled. There's no intelligence and you're literally controlling the mechanism with your dial. You were literally navigating through a switch with each digit you dialled.
Crossbars received the digits in a register, which was originally relay-based logic and later may have been computerised, that then passed the digits to a 'marker' which figured out the route through the switching matrix and setup a path. So they were actually using intelligence and logic, even if it was often 100% analog. They were basically analog computers. Amazing pieces of technology when you consider how reliable they were given the technical limitations of relay logic. Some of the basic concepts from that stuff have ended up carrying through to modern microprocessors too.
Panel and Rotary type were also common control, albeit it done quite differently.
Marker:
https://en.wikipedia.org/wiki/Marker_(telecommunications)
On digital switches it would be very, very unusual not go get a dial tone immediately when you pick up the phone. So, in reality dial tones probably haven't been needed for a very long time.
If you were going through to an operator service on an old system, you'd have picked up the phone and either got silence and then the operator, or a ringing tone and then the operator.