Ralph was married twice and had over twenty children. He arranged marriages for his children to other important nobles. The most important was that of his daughter Cecily to Richard of York, a descendant of Edward III. The arrangement was made while Cecily and Richard were only children and before the conflict of the Wars of the Roses between the Yorkists and the Lancastrians. This marriage would link the Nevilles to the Yorkists in the future war.
When Ralph died he was buried in the church at Staindrop, County Durham, near his ancestral home of Raby Castle. A monument to the earl can still be seen at the church today. Beside him on the monument are Joan Beaufort and his first wife Margaret Stafford.