Most new divers limit themselves to about 60 feet. The idea is not to go deeper because it is possibly more interesting, but rather to learn about the area so that you know what to expect. From there, make a plan which safely gets you there and back.
I have had great dives shallower than 20 feet and been down as deep as 125. I enjoyed all but one. In the first case, there were a host of fish and other creatures just off of the dock in Palau which were fun to photo. In the second, we were looking at a deep tunnel which comes out into the ocean. We dropped through quickly; exited and then continued to a fairly shallow depth in comfort and safety. But we went through a planning exercise and used good computers.
Get certified.
Get the right equipment.
Follow the guidelines while watching out for your buddies.