Prince Andrew attends Easter service at Windsor Castle on March 31, 2024.Photo:JUSTIN TALLIS/AFP via Getty

Britain’s Prince Andrew, Duke of York reacts as he arrives at St. George’s Chapel, Windsor Castle, to attend the Easter Mattins Service, on March 31, 2024.

JUSTIN TALLIS/AFP via Getty

Joining the royal couple for theEaster Mattins Service at St. George’s Chapel at Windsor CastlewerePrince Andrewand his ex-wife Sarah Ferguson, Princess Anne and her husband Vice Admiral Sir Tim Laurence and Prince Edward and his wife Sophie, Countess of Wessex.

Andrew’s attendance comes one month after hefaced backlashfor leading the royal family at a memorial service honoring the lateKing Constantine of Greece.

The Duke of York, 64, has denied any wrongdoing and settled with Giuffre out of court for an undisclosed amount in February 2022.

Prince Andrew attends Easter service at Windsor Castle on March 31, 2024.Chris Jackson/Getty

WINDSOR, ENGLAND - MARCH 31: Prince Andrew, Duke of York attends the Easter Mattins Service at Windsor Castle on March 31, 2024 in Windsor, England.

Chris Jackson/Getty

Despite stepping away from public engagements, Prince Andrew has continued to join the royals for family events such as holiday church outings, funerals and other services. He also attended the coronation of his brotherKing Charlesin May 2023.

Sarah Ferguson arrives for Easter service at Windsor Castle on March 31, 2024.Chris Jackson/Getty

WINDSOR, ENGLAND - MARCH 31: Sarah, Duchess of York attends the Easter Mattins Service at Windsor Castle on March 31, 2024 in Windsor, England.

It’s understood that the Prince and Princess of Wales and their children are spending the long weekend privately, and Easter falls a little more than a week after Princess Kate shared the “shock” news about her health in a personal video message released on March 22.

King Charles and Queen Camilla attend Easter church service at Windsor Castle on March 31, 2024.Hollie Adams - WPA Pool/Getty

WINDSOR, ENGLAND - MARCH 31: King Charles and Queen Camilla arrive to attend the Easter Mattins Service at Windsor Castle on March 31, 2024 in Windsor, England.

Hollie Adams - WPA Pool/Getty

“We hope that you will understand that, as a family, we now need some time, space and privacy while I complete my treatment… for now I must focus on making a full recovery,” the Princess of Wales said in the video filmed in the garden of Windsor Castle, not far from her family’s home at Adelaide Cottage.

The royal family’s trips to church for major holidays like Easter and Christmas are technically private family events rather than royal duties, but this year’s plans were expected to be pared down in light of guidance around the King’s health. The Easter service was said to be planned for a smaller scale than usual, following doctors' advice to limit the number of people the King should come in contact with during his treatment.

Princess Anne arrives for Easter service at Windsor Castle on March 31, 2024.Chris Jackson/Getty

WINDSOR, ENGLAND - MARCH 31: Princess Anne, Princess Royal attends the Easter Mattins Service at Windsor Castle on March 31, 2024 in Windsor, England.

Buckingham Palace announced on Feb. 5 that the sovereign wasdiagnosed with cancerfollowing surgery for a benign enlarged prostate and would postpone public-facing duties while receiving treatment. The type of cancer has not been disclosed, but a spokesman confirmed it is not prostate cancer.

Sophie, Duchess of Edinburgh and Prince Edward, Duke of Edinburgh attend Easter church service at Windsor Castle on March 31, 2024.Chris Jackson/Getty

Sophie, Duchess of Edinburgh and Prince Edward, Duke of Edinburgh attend the Easter Mattins Service at Windsor Castle on March 31, 2024 in Windsor, England.

A royal source tells PEOPLE the monarch is “progressing well” in his treatment, and there is an “amplified confidence” in the light of the sophisticated treatment he is receiving.

“He is positive, the doctors are optimistic,” the source says.

King Charles and Queen Camilla lead the royal family’s walk to church on Christmas at Sandringham on December 25, 2023.Samir Hussein/WireImage

King Charles III, Queen Camilla, Catherine, Princess of Wales, Prince George of Wales, Prince William, Prince of Wales andMia Tindall attend the Christmas Morning Service at Sandringham Church

Samir Hussein/WireImage

Can’t get enough of PEOPLE’s Royals coverage?Sign up for our free Royals newsletterto get the latest updates on Kate Middleton, Meghan Markle and more!

The royal family was out infull forceon Christmas Day in December 2023, where King Charles and Queen Camilla led the charge to the Church of St. Mary Magdalene in Norfolk. It was the second Christmas of King Charles’ reign, and extra special as King Charles reportedly invited Queen Camilla’s family to celebrate at the royal residence ofSandringhamfor the first time.

In years past, Camilla would leave in the afternoon to spend time with her son Tom Parker Bowles, daughter Laura Lopes and their children, so the idea of everyone coming together would create a modern family feel.

source: people.com