Set the PROMPT1 variable using psql prompt escape sequences:

\set PROMPT1 '[%n@%M:%/]=%# '

• %n - User
• %M - Host ([local] or the domain or IP address of the server)
• %/ - Database
• %# - # if superuser, $ if regular user.