In a heretical way, or to a heretical extent(adverb)
Wiktionary.org : Text is available under the Creative Commons Attribution-ShareAlike License
Use "heretically" in a sentence
"In heretically reductive heavy-metal terms, Megadeth is the Rolling Stones to Metallica's Beatles: more dangerous, more unhinged, more given to self-destruction and a nagging lack of luck."
"The best supporting actress prize to Octavia Spencer, for The Help, will nettle those who find this movie highly sucrose and even suspect, and who felt that, heretically, it might have been more interesting for Melissa McCarthy's out-and-out comedy performance in Bridesmaids to have been rewarded."
"There are, of course, idiotic mystery novels published every month, but they are not what tempt me (an otherwise stalwart fan and critical apostle for the genre) to take Wilson's scorn seriously; rather, it's the elaborately executed twizzler of a tale that unwinds into pointlessness that moves me to heretically entertain the truth of Wilson's famous sneer: "Who Cares Who Murdered Roger Ackroyd?""