Afridi served legal notice on his controversial comment