Rowley's grandfather only appears in Rodrick Rules, when it's his birthday and he asks for a chocolate cake for his next birthday and Greg replies "If you're even alive next year", thus stating he is really old.
In the Rodrick Rules movie, Greg's grandfather has this role instead.