The arrival of more out-of-town Parsis and Iranis from Bombay and Poona only added to the tension and criticism brewing among Gulmai's relatives. In the local newspapers, too, more attacks against Meher Baba appeared. Thus, indignation against Meher Baba and his followers was the chief topic of conversation among the skeptical Zoroastrian guests. On the morning of 4 May, while Adi was helping Baba with his daily ablutions, he informed him of the gossip going on behind his back and of the prevailing atmosphere of criticism. Adi made it clear that several people at Sarosh Manzil, his family's house, especially Gulmai's brother, Minochershaw, were inciting the other wedding guests against him. The night before, Adi reported, there had been a loud, heated argument between Rustom and his Uncle Minochershaw over Baba. Baba was already annoyed that Gulmai had not yet returned from Sakori, as he had instructed. Hearing what Adi said, Baba abruptly left his room and stormed out of the compound without saying a word.

That morning, some of the men were in the bathrooms washing, and some were in the middle of breakfast. But the Master's standing order was that wherever he went the mandali should follow immediately, no matter what they happened to be doing. Thus, hearing the cry that Baba was leaving, the mandali hurried to follow him as quickly as they could, unaware of where he was going. Baba walked rapidly through the city with a serious expression. He stopped on Station Road with Behramji, Nervous, Padri, Masaji, Pendu and Slamson in tow.

At first, they thought he was going to the railway station, and they wondered about their belongings left behind at Khushru Quarters. But after coming to the Sina River, Baba instead began walking north along the riverbed. They stopped by a well in a field and refreshed themselves. Then Baba turned back, crossed the bridge and went to the railway station where they had a snack at the adjoining dharamshala.

Continuing, after trudging six miles along the Dhond Road, they saw some dilapidated buildings and a small village nearby. When they entered the property, they came across a watchman who informed them that the structures had formerly housed a British military post and were now owned by Khansaheb Kaikhushru Irani of Ahmednagar. The nearby village was Arangaon.

The mandali were surprised because, although they had heard about Arangaon and Baba's intention of staying there, they did not know its location. Gulmai had only mentioned the name of the place and had planned to take Baba there after Rustom's marriage. Baba sat down under a neem tree by an old well. He pointed out the recently constructed tomb of Gilori Shah, a few feet away, then observed the neglected buildings, a small howd (cistern) and a flagstone platform. 

The mandali had neither a change of clothes, food, nor drinking water with them. Baba sent Behramji and Slamson to Arangaon Village to fetch something to eat.