A plan to build extra floors and add three flats at an office block near three Brighton music venues has been refused.