I solved it. Make sure acpid is installed, then create /etc/acpi/events/power_button with the following:
event=button/power PBTN 00000080 00000000
action=/sbin/poweroff
Your event may differ, but you can look it up by running acpi_listen and then sending the ACPI shutdown command.