According to Unicom it's only: Plain form verb + あまり Noun + の + あまり
The thing about the adjectives is that you need to change them into nouns in order to use them with あまり. There's already a grammar point for that here: *** http://www.renshuu.org/index.php?page=grammar/individual&id=128
So if you want to use the i- and na-adjective in the construction, you need to change な-adjective A + あまり to な-adjective: noun form A + の + あまり
***: +さ is only being added to the i-adjectives to point out that it became a quantifying noun. I don't think さ is used with na-adjectives.
I double checked myself, and couldn't find the たあまり form. However, I don't think it hurts to leave the noun-forms of the adjectives on this page so they don't have to go off somewhere else to see it.