While the league may provide some of these to you there may be some supplies you don't have that you will need to purchase (or have donated).
Little League International also provides access to a "Coaches Toolkit":
http://www.littleleague.org/managersandcoaches/coachestoolkit.htm