If a property owner in a historic district, or the owner of a historic landmark or landmark site, is denied a certificate of appropriateness, the property owner may appeal such decision either to the governing authority of the city or county or combination thereof or may, if such venue has been made available at the discretion of the governing authority, appeal directly to the chancery court. Any such appeal shall be reviewed upon the record established before the local historic preservation commission. Any local property owner or organization aggrieved or damaged by such a decision may appeal in the same manner.