It’s not a cost of sale, but you could argue it’s a direct cost. General stationery is an overhead - which are expenses related to the running of your business rather than directly related to the products you sell.
As @Paul_Courtier pointed out though, it makes no difference to your overall tax position, but may be helpful to you in understanding how much you spend getting your goods to your customers.