Can I use a formula like TODAY() in the With These Values field?
You can update variable {{TODAY}} as field value, please refer to this article:
https://www.ragic.com/intl/en/doc/79/Update-Values#4
Can I use the variable on the update values custom button?
It can be used on update value in this sheet, but not supported on update value on another sheet.