I haven't had a chance to try it out myself yet, but the Aurora FAQ[0] seems confirm your wish:
Aurora database engine is designed to be wire-compatible with PostgreSQL 9.6 and 10, and supports the same set of PostgreSQL extensions that are supported with RDS for PostgreSQL 9.6 and 10
For reference, full list of PostgeSQL RDS extensions in the documentation[1]
Thanks