Take the Long Island Rail Road to Greenport, usually changing at Ronkonkoma. The harbor and village center are near the station. Check the return departure before you choose an outing, since fewer trains run on this end of the line than on inner Long Island.