Share

No more black box: patient sees future face after skin surgery

June 11, 2026

To use AI to predict what a face will look like after skin cancer surgery, PhD researcher Tim d’Hondt collects the right data. With this data, a reconstruction can be created to help patients decide on the best treatment option.

Photo:iStock
Photo:iStock

Plastic surgeon Maarten Hoogbergen of Catharina Hospital is working on AI that will soon help patients make decisions after facial skin cancer surgery. Tim d’Hondt, PhD researcher in the Data Mining and AI group at the Department of Mathematics & Computer Science (M&CS), studied how data used by AI should be collected. “We’re really at the beginning,” says Hoogbergen. “This is the investment phase.”

Imagine this: you develop skin cancer on your face. The tumor has to be removed. That leaves a wound that needs reconstruction. For some patients, achieving the best possible cosmetic result is most important. For others, a fast recovery or minimizing additional surgeries matters most.

This is exactly where plastic surgeon wants to apply AI in the future. Not to replace the physician’s decision, but to support the conversation between patient and doctor. Which treatment makes medical sense? And which outcome aligns with the patient’s desired quality of life?

Tim
Tim d'Hondt. Photo: Angeline Swinkels

Making your own choices

For , this is an opportunity to apply his knowledge in practice. “If we collect enough data, we can show future patients—through different models—what their face might look like after surgery. That way, they can help decide on their treatment. It won’t be a black box for them anymore.”

The ultimate goal is to present patients with two types of predictions: first, a prediction of satisfaction for a given treatment choice, based on demographic characteristics, patient preferences, wound location, etc. “We call this the satisfaction model,” d’Hondt explains. In addition, there will be a visual prediction of the face, generated by an AI model trained on hundreds of photos of previous surgeries and their outcomes.

Patients currently undergoing treatment won’t yet see a ready-made AI tool on the desk—and that’s exactly the point. “Right now, patients mainly notice that they are providing data,” Hoogbergen says. “They fill out questionnaires, have photos taken, and give consent. We are focused on collecting the right data. That’s necessary to make reliable predictions later.”

Maarten
Maarten Hoogbergen. Photo: Rob van Beek

Laying the groundwork

AI often sounds like something magical: a smart system that produces answers in seconds. But before such a system can safely and reliably assist in healthcare, a lot of less glamorous work has to be done. At the moment, Catharina Hospital is essentially laying the groundwork: collecting data, organizing processes, and ensuring patient information is securely and usefully recorded.

Over the past year, d’Hondt worked with Industrial Design master’s student Blom van der Toom to fully map out the care process for patients with facial skin cancer, identifying where and how data can be collected and used. When does the patient receive information? When is consent requested? When are photos taken? When do they complete questionnaires? And how do we ensure all that information ends up in the right place?

“You have to get that right,” Hoogbergen says. “You don’t want healthcare providers constantly figuring out which form is needed or which step comes next. The process must be set up so that the patient is well informed and we can collect reliable data in a safe way.”

This data includes medical images. Patients are photographed at fixed points in time: before the procedure, after reconstruction, and during follow-up. They also complete the FACE-Q Skin Cancer questionnaire, which measures how patients experience their appearance, recovery, and quality of life.

The patient’s voice

For Hoogbergen, that is the core of the project—not the technology itself, but the patient’s voice. “As a physician, you’re always influenced by your training, your experience, and your own ideas of what a good result is,” he says. “But what I consider a good outcome may not be what the patient finds most important.”

This is also a crucial element for d’Hondt. “You want patients to stand behind their own treatment process.” He describes the project as “a great combination of rigorous problem modeling and providing patients with useful information.” He attended multiple conversations between doctors and patients, gaining insight into how decisions are currently made, what information is missing, and how better data collection could improve that.

Reducing anxiety

“You want to take away people’s fears and reassure them that things will turn out well,” d’Hondt explains. Hoogbergen adds his own perspective, recalling patients who, by his technical standards, had excellent results but were still dissatisfied. And others for whom he was critical of the outcome, while they were actually very happy because they could return to what mattered most to them.

“That’s when I thought: wait a minute. How can my assessment differ so much from the patient’s experience? I need to do something with that.”

Since then, Hoogbergen has focused on outcome measurements in plastic surgery. This goes beyond medical results to include what the treatment means for a patient’s daily life. Can they socialize again? Do they feel comfortable with their appearance? Was the burden of treatment worth it?

Learning from previous patients

The next step is for AI to learn from previous patients by combining photos, medical data, and questionnaire outcomes. In the future, this could allow the system to predict which treatment offers each patient the highest likelihood of achieving an outcome aligned with their preferences.

But the project isn’t there yet. “We’re really at the beginning,” Hoogbergen says. “First, you need a strong AI system that can predict what the result of a reconstruction might look like. Then you have to link that prediction to questionnaire outcomes. Only then can you truly determine which treatment gives each patient the best chance at their desired quality of life.”

Testing with eyebrows

To build such an AI system, it must first be tested with data similar to the still-limited patient data available today. d’Hondt is currently working on this exploratory research with master’s student Rozhan Moosavi. “She’s testing the system using many different images of eyebrows. This allows us to train a model to generate eyebrows with specific characteristics—such as thickness or color—that we define in advance. Just like the model will later need to generate scar tissue based on the treatment method applied.”

So it’s not simply a matter of building an app and being done. It involves years of work: collecting data, training models, verifying predictions, and ensuring everything is done safely and carefully.

Building something exciting

The more data, the better. d’Hondt hopes that Catharina Hospital can persuade partner hospitals to collect data as well. “That way, we can build something truly exciting much faster.” And he can reassure people concerned about patient privacy: “The photos are securely stored under strict digital safeguards. We design the model so that it does not leak sensitive data, such as images.”

The project aligns with the mission of the Center for Safe AI, a ϸ initiative currently in development. Within this center, both technical and socio-technical challenges associated with the development and application of AI are addressed, with particular focus on effectiveness, robustness, fairness, accountability, and human–AI collaboration.

Keeping the focus

In this project, AI remains a tool to support the conversation. The physician is still essential. The patient remains at the center. The technology helps provide a stronger foundation for decision-making. This also reflects Catharina Hospital's broader approach: AI is not an end in itself. It should help make care smarter, more personalized, and affordable.

Within the clinic, d’Hondt observes that there are some doubts about the system being tested. “The physicians who participate and invest their time aren’t seeing much in return yet. Right now, we’re mainly focused on collecting data. They have to trust that it will pay off.” It’s up to d’Hondt and the master’s students supporting him to keep medical specialists engaged and interested.
 

The base of this article was written by as part of their monthly series ‘Vooruit met de zorg’ (Moving Healthcare Forward). In this series, the hospital shows how innovation, such as AI, contributes to better, more patient-centered care.

 

Keep following us