The only son of Robert Stayner and Mary Anne Holford. At the age of 20 in 1880 George obtained a commission with the 1st Life Guards where he remained for almost 30 years. When his father died in 1892 he inherited Westonbirt House and Aboretum and also inherited Dorchester House in London and the art and book collection that were housed within it. He did not have his father's interest in art and books but he did have a passion for gardens and orchids so he devoted much of his time to his property at Westonbirt.