This paper studies a sequential bargaining model of a decentralized market. A main objective is to explore the conditions under which the unique subgame perfect equilibrium outcome of the market game approximates the Walrasian outcome of the market. The three main messages that emerge from our results are as follows. First, contrary to conventional wisdom, friction less markets need not be Walrasian. Second, the relative magnitudes of frictions can have a profound impact on the market outcome even in the limit as the absolute magnitudes of the frictions become negligible. And third, the relative magnitudes of certain types of frictions may have to be significantly large in order for markets to be Walrasian, reflecting that certain types of frictions are needed in the market in order to induce the Walrasian outcome.