Basically, all you need to do is create a path to the upper area, something that will happen naturally via story progression, and then plant anything that blocks that breakable wall from spawning on another cycle.
Since this ended up being a lot simpler than I expected, I also included the path to the "No Sword" room. This is not required for this trophy/achievement, but is required for Cosmographical Meditations. You might as well do both since it requires getting out of the starting area without a sword anyway.