Aqueous coating paper straw