There's of course a whole range of scientific publications, but any list would either be incomplete or contain some strong bias, both of which wouldn't be great.
So instead only pointers to some special kinds of literature are provided.
The books listed here either have some chapter(s) on hierarchical planning, or are specifically devoted to hierarchical planning. Since there so many versions of books like newer editions that come with different ISBNs etc. only titles and authors are provided, but no bibtex entries (as also publishers might change depending in which version one refers to).
Ordered alphabetically by title.
Artificial Intelligence – A Modern Approach
by S. Russell, P. Norvig, Prentice Hall, 2010.
(Only approx. 10/1300 pages about hierarchical planning, more is spent on non-hierarchical planning.)
Automated Planning and Acting
by M. Ghallab, D. Nau, P. Traverso, Cambridge University Press, 2016.
(Only a very few pages are on hierarchical planning.)
Automated Planning: Theory and Practice
by M. Ghallab, D. Nau, P. Traverso, Morgan Kaufmann, 2004.
(1+/24 chapters are on hierarchical planning.)
Intelligent Planning – A Decomposition and Abstraction Based Approach
by Q. Yang, Springer, 1997.
(The entire book is about hierarchical planning.)
Readings in Planning
by James Allen, James Hendler, and Austin Tate, Morgan Kaufmann, 1990.
(Summarises work on AI planning and reprints key papers from the 1960s to the early 1990s up to and including work on hierarchical partial-order planners such as NOAH, NONLIN and SIPE. See table of contents and index.)
YouTube channel of the HPlan workshop for Hierarchical Planning.