AI-Assisted Surgical Marking and Injectable Filler System for Facial Cosmetic Procedures
用于面部美容手术的 AI 辅助手术标记和注射填充系统
Field of the Invention
发明领域
This invention pertains to the fields of cosmetic medical procedures and artificial intelligence (hereinafter “AI”).
本发明涉及美容医疗程序和人工智能（以下简称 "AI"）领域。
Background of the Invention
发明背景
Facial cosmetic procedures encompass a range of interventions, including surgeries such as rhinoplasty, blepharoplasty, rhytidectomy (facelift), otoplasty, chin augmentation, lip augmentation, brow lifts, and injectable fillers. Each procedure requires precise planning to achieve optimal aesthetic and functional outcomes.
面部美容手术包含一系列干预措施，包括鼻整形术、眼睑整形术、皱纹切除术（拉皮术）、耳部整形术、隆下巴、丰唇、提眉和注射填充物等手术。每项手术都需要精确的规划，以达到最佳的美学和功能效果。
Surgical markings serve as critical blueprints, guiding surgeons in executing procedures with precision. Traditionally, these markings are manually drawn, relying heavily on the surgeon’s expertise and judgment. However, manual markings are subjective and prone to variability, potentially leading to asymmetry, inefficiency during surgery, and suboptimal outcomes. Additionally, they are time-intensive, lack reproducibility, and may not always align perfectly with a patient’s unique anatomy or desired aesthetics.
手术标记是指导外科医生精确执行手术的重要蓝图。传统上，这些标记都是人工绘制的，主要依靠外科医生的专业知识和判断。然而，手工标记具有主观性，容易产生变异，可能导致不对称、手术效率低下和效果不理想。此外，这种方法耗时长，缺乏可重复性，而且不一定完全符合患者的独特解剖结构或所需的美学效果。
Injectable dermal fillers require accurate placement to enhance facial contours, reduce wrinkles, or restore volume. Achieving desired results with minimal invasiveness necessitates precise injection site determination, accurate filler quantity, and awareness of critical anatomical structures like bone, blood vessels and nerves. The use of lower-gauge needles, which are more susceptible to complications such as puncturing blood vessels or nerves, amplifies these challenges. Variability in injector expertise and anatomical differences further complicate achieving consistent results.
注射皮肤填充剂需要准确的位置，以增强面部轮廓、减少皱纹或恢复容积。要想以最小的创伤获得理想的效果，就必须准确确定注射部位、精确填充量，并注意骨骼、血管和神经等重要解剖结构。使用低号针头更容易出现并发症，如刺穿血管或神经，这也加剧了这些挑战。注射人员的专业技能参差不齐以及解剖结构上的差异，也使实现一致的效果变得更加复杂。
A significant challenge in facial cosmetic procedures lies in the consultation phase. Potential patients are often hesitant to proceed due to uncertainty about the results, leading to prolonged consultations where doctors attempt to explain and visualize potential outcomes. Current methods, such as before-and-after photo comparisons, manual sketches, or static simulations, often fail to capture the dynamic nature of personalized results. This misalignment can lead to dissatisfaction, hesitation, or unrealistic expectations, impacting both patient confidence and procedural outcomes.
面部美容手术的一大挑战在于咨询阶段。潜在患者往往因为不确定手术效果而犹豫不决，这就导致了漫长的咨询过程，医生在这一过程中试图解释并直观展示潜在的手术效果。目前的方法，如前后照片对比、手工草图或静态模拟，往往无法捕捉个性化效果的动态特性。这种错位会导致患者不满意、犹豫不决或不切实际的期望，从而影响患者的信心和手术效果。
Advancements in artificial intelligence, particularly in facial recognition and medical imaging, have demonstrated significant promise across various fields. Facial recognition systems use convolutional neural networks (CNNs) to analyze facial features, contours, symmetry, and proportions with high accuracy from images and video. In the medical domain, facial recognition algorithms have been employed to diagnose syndromes, assess facial symmetry, and track changes in facial structures over time. However, most current systems excel at static facial analysis and lack the dynamic, real-time adaptability and responsiveness required in surgical and injectable consultations. In addition, AI solutions tailored to cosmetic applications often fail to incorporate comprehensive datasets, such as demographic variability, medical imaging, and feedback loops, to ensure customization and reliability.
人工智能的进步，尤其是在面部识别和医学成像方面的进步，已在各个领域展现出巨大的前景。面部识别系统使用卷积神经网络（CNN）从图像和视频中高精度地分析面部特征、轮廓、对称性和比例。在医疗领域，面部识别算法已被用于诊断综合症、评估面部对称性和跟踪面部结构随时间的变化。然而，目前大多数系统都擅长静态面部分析，缺乏手术和注射咨询所需的动态、实时适应性和响应性。此外，为美容应用量身定制的人工智能解决方案往往未能纳入全面的数据集，如人口统计学变异、医学影像和反馈回路，以确保定制化和可靠性。
The integration of artificial intelligence (AI) into medical procedures has shown significant promise across various fields, including diagnostics, treatment planning, and robotic surgery. However, its application to surgical markings and dermal fillers, particularly in facial cosmetic surgery, remains underexplored. Current AI solutions for surgery are often limited to image recognition or assisting with intraoperative decision-making, with little focus on preoperative planning tools that assist with consultations or directly impact surgical precision.
将人工智能（AI）融入医疗程序已在诊断、治疗规划和机器人手术等多个领域显示出巨大前景。然而，人工智能在手术标记和皮肤填充剂方面的应用，尤其是在面部美容手术中的应用，仍未得到充分探索。目前用于外科手术的人工智能解决方案通常仅限于图像识别或协助术中决策，而很少关注协助会诊或直接影响手术精度的术前规划工具。
Summary of the Invention
发明概述
One or more embodiments of the present invention address the application of AI in cosmetic procedures such as facial cosmetic surgery. One or more embodiments of the present invention include apparatuses, systems, and methods for predicting the three dimensional visualization of post-operation results during consultations, generating precise surgical markings for cosmetic surgery, and determining injection points, quantities, and trajectories for injectable fillers such as Botox (trademarked) and hyaluronic acid.
本发明的一个或多个实施例涉及人工智能在面部整容手术等美容手术中的应用。本发明的一个或多个实施例包括用于在会诊期间预测手术后效果的三维可视化、生成用于整容手术的精确手术标记以及确定肉毒杆菌毒素（商标）和透明质酸等可注射填充剂的注射点、数量和轨迹的装置、系统和方法。
One or more embodiments of the present invention provide a novel AI-assisted system, method, and apparatus designed to enhance the planning and consultations of cosmetic procedures such as facial cosmetic surgery. One or more embodiments may be used in clinical practice such as during consultations and in medical training environments. One or more embodiments may be used in assisting clinical practices by apply markings or plans automatically to a patient’s face with minimal surgeon intervention.
本发明的一个或多个实施例提供了一种新颖的人工智能辅助系统、方法和设备，旨在增强面部整容手术等美容手术的规划和咨询。一个或多个实施例可用于临床实践，例如在会诊期间和医疗培训环境中。一个或多个实施例可用于协助临床实践，在外科医生干预最少的情况下自动将标记或计划应用到患者的面部。
In at least one embodiment, a computing system is provided comprising: at least one computer processor; an artificial intelligence (AI) Engine module comprising at least one artificial intelligence model; and a computer memory that stores instructions that, when executed by the at least one computer processor, causes the at least one computer processor to perform operations, including: receiving Input Data entered into an Input module by a user; using the AI Engine module to process the Input Data; using the AI Engine module to generate a procedure plan based on the Input Data; generating a visualization of a postoperative patient’s face as predicted by the AI Engine module based on the Input Data and the procedure plan generated by the AI Engine module; storing the visualization of the postoperative patient’s face in a computer memory; and displaying the visualization of the postoperative patient’s face through a Visualization module.
在至少一个实施例中，提供了一种计算系统，该系统包括：至少一个计算机处理器；人工智能（AI）引擎模块，该模块包括至少一个人工智能模型；以及计算机存储器，该存储器存储指令，当指令被至少一个计算机处理器执行时，使至少一个计算机处理器执行操作，包括接收用户输入到输入模块中的输入数据；使用人工智能引擎模块处理输入数据；使用人工智能引擎模块根据输入数据生成手术计划；根据输入数据和人工智能引擎模块生成的手术计划，生成人工智能引擎模块预测的术后患者面部可视化；将术后患者面部可视化存储在计算机存储器中；以及通过可视化模块显示术后患者面部可视化。
In a least one embodiment, after the step of generating the visualization of the postoperative patient’s face, the at least one computer processor is configured to enable the user to modify the Input Data; and the at least one computer processor is configured to generate a modified visualization of the postoperative patient’s face in a computer memory based on the modification of the Input Data.
在至少一个实施例中，在生成术后患者面部可视化的步骤之后，至少一个计算机处理器被配置为使用户能够修改输入数据；并且至少一个计算机处理器被配置为根据对输入数据的修改在计算机存储器中生成修改后的术后患者面部可视化。
The at least one computer processor may be configured to enable the user to modify the procedure plan; and to generate a modified visualization of the postoperative patient’s face in computer memory based on modification of the procedure plan by the user.
至少一个计算机处理器可配置为使用户能够修改手术计划；并根据用户对手术计划的修改，在计算机存储器中生成术后患者面部的修改可视化。
The procedure plan may include surgical markings.
手术计划可能包括手术标记。
The at least one computer processor may be configured to generate a visualization of a preoperative patient’s face with generated surgical markings shown overlaid on top of the preoperative patient’s face by use of the AI Engine module.
至少一个计算机处理器可配置为生成术前患者面部的可视化图像，并通过使用人工智能引擎模块在术前患者面部上方叠加显示生成的手术标记。
The modification of the procedure plan by the user may include modification to the surgical markings.
用户对手术计划的修改可包括对手术标记的修改。
In at least one embodiment, a computing system is provided which includes at least one computer processor; an AI Engine module comprising at least one artificial intelligence model; a computer memory that stores instructions that, when executed by the at least one computer processor, causes the at least one computer processor to perform operations, including: receiving Input Data entered into an Input module by a user; using the AI Engine module to process the Input Data; generating a visualization of a postoperative patient’s face as predicted by the AI Engine module based on the Input Data; and displaying a visualization of the postoperative patient’s face through a Visualization module.
在至少一个实施例中，提供了一种计算系统，该系统包括至少一个计算机处理器；一个人工智能引擎模块，该模块包括至少一个人工智能模型；一个计算机存储器，该存储器存储指令，当指令被至少一个计算机处理器执行时，使至少一个计算机处理器执行操作，包括接收用户输入到输入模块中的输入数据；使用人工智能引擎模块处理输入数据；生成人工智能引擎模块根据输入数据预测的术后患者面部可视化；以及通过可视化模块显示术后患者面部可视化。
The at least one computer processor may be configured to generate an alternative visualization of the postoperative patient’s face as predicted by the AI Engine module based on the Input Data, and to display the alternative visualization of the postoperative patient’s face through the Visualization module.
至少一个计算机处理器可配置为生成人工智能引擎模块根据输入数据预测的术后患者面部的替代可视化，并通过可视化模块显示术后患者面部的替代可视化。
The at least one computer processor may be configured to generate a further plurality of alternative visualizations of the postoperative patient’s face as predicted by the AI Engine module based on the Input Data, and to display the plurality of alternative visualizations of the postoperative patient’s face through the Visualization module.
至少一个计算机处理器可配置为根据输入数据生成人工智能引擎模块预测的术后患者面部的多个备选可视化图像，并通过可视化模块显示术后患者面部的多个备选可视化图像。
The AI Engine module may be configured to generate a procedure plan based on the Input Data and the visualization of the postoperative patient’s face
人工智能引擎模块可配置为根据输入数据和术后患者面部可视化生成手术计划
In at least one embodiment, after the AI Engine module generates the visualization of the postoperative patient’s face, the at least one computer processor is configured to enable the user to modify the Input Data; and the at least one computer processor is configured to generate a modified visualization of the postoperative patient’s face based on modification of the Input Data by the user.
在至少一个实施例中，在人工智能引擎模块生成术后患者面部的可视化之后，至少一个计算机处理器被配置为使用户能够修改输入数据；并且至少一个计算机处理器被配置为根据用户对输入数据的修改生成术后患者面部的修改后可视化。
The at least one computer processor may be configured to enable the user to modify the procedure plan; and to generate modified visualization of the postoperative patient’s face based on modification of the procedure plan.
至少一个计算机处理器可配置为使用户能够修改手术计划；并根据手术计划的修改生成术后患者面部的修改可视化。
The at least one computer processor may be configured to create a visualization of a preoperative patient’s face by use of generated surgical markings overlaid on top of the preoperative patient’s face as created by the AI Engine module.
至少一个计算机处理器可配置为通过使用人工智能引擎模块创建的覆盖在术前患者面部之上的已生成手术标记，创建术前患者面部的可视化。
In at least one embodiment, a method is provided which includes receiving into a computer processor, Input Data entered into an Input module by a user; using an AI Engine module to process the Input Data; using the AI Engine module to generate a procedure plan based on the Input Data; generating a visualization of a postoperative patient’s face as predicted by the AI Engine module based on the Input Data and the procedure plan generated by the AI Engine module; storing the visualization of the postoperative patient’s face in a computer memory; and displaying the visualization of the postoperative patient’s face through a Visualization module.
在至少一个实施例中，提供了一种方法，该方法包括向计算机处理器接收由用户输入到输入模块中的输入数据；使用人工智能引擎模块处理输入数据；使用人工智能引擎模块根据输入数据生成程序计划；根据输入数据和人工智能引擎模块生成的程序计划，生成人工智能引擎模块预测的术后患者面部可视化；将术后患者面部可视化存储在计算机存储器中；以及通过可视化模块显示术后患者面部可视化。
In at least one embodiment, after the step of generating the visualization of the postoperative patient’s face, the method may include enabling the user to modify the Input Data; and generating a modified visualization of the postoperative patient’s face in a computer memory based on the modification of the Input Data.
在至少一个实施例中，在生成术后患者面部可视化的步骤之后，该方法可包括使用户能够修改输入数据；以及根据对输入数据的修改，在计算机存储器中生成术后患者面部的修改后可视化。
The method may further include enabling the user to modify the procedure plan; and generating a modified visualization of the postoperative patient’s face in a computer memory based on modification of the procedure plan by the user.
该方法可进一步包括使用户能够修改手术计划；以及根据用户对手术计划的修改，在计算机存储器中生成术后患者面部的修改可视化。
The procedure plan may include surgical markings.
手术计划可能包括手术标记。
The method may further include generating a visualization of a preoperative patient’s face with generated surgical markings shown overlaid on top of the preoperative patient’s face by use of the AI Engine module.
该方法可进一步包括使用人工智能引擎模块生成术前患者面部的可视化图像，并在术前患者面部上方叠加显示生成的手术标记。
The method may further include generating a visualization of a preoperative patient’s face with surgical markings shown overlaid on top of the preoperative patient’s face by use of the AI Engine module; wherein modification of the procedure plan by the user includes modification to the surgical markings.
该方法可进一步包括通过使用人工智能引擎模块，生成术前患者面部的可视化图像，并在术前患者面部上方叠加显示手术标记；其中，用户对手术计划的修改包括对手术标记的修改。
In at least one embodiment of the present invention, a method is provided which may include
在本发明的至少一个实施方案中，提供了一种方法，其中可包括
receiving at a computer processor, Input Data entered into an Input module by a user; using an AI Engine module to process the Input Data; generating a visualization of a postoperative patient’s face as predicted by the AI Engine module based on the Input Data; and displaying a visualization of the postoperative patient’s face through a Visualization module.
在计算机处理器上接收用户输入到输入模块中的输入数据；使用人工智能引擎模块处理输入数据；根据输入数据生成人工智能引擎模块预测的术后患者面部可视化图像；以及通过可视化模块显示术后患者面部可视化图像。
The method may further include generating an alternative visualization of the postoperative patient’s face as predicted by the AI Engine module based on the Input Data, and displaying the alternative visualization of the postoperative patient’s face through the Visualization module.
该方法可进一步包括生成人工智能引擎模块根据输入数据预测的术后患者面部的替代可视化，并通过可视化模块显示术后患者面部的替代可视化。
The method may further include generating a further plurality of alternative visualizations of the postoperative patient’s face as predicted by the AI Engine module based on the Input Data, and
该方法可进一步包括生成人工智能引擎模块根据输入数据预测的术后患者面部的多个备选可视化图像，以及
displaying the plurality of alternative visualizations of the postoperative patient’s face through the Visualization module.
通过可视化模块显示术后患者面部的多个备选可视化图像。
The AI Engine module may be configured to generate a procedure plan based on the Input Data and the visualization of the postoperative patient’s face.
人工智能引擎模块可配置为根据输入数据和术后患者面部可视化生成手术计划。
In at least one embodiment, after the AI Engine module generates the visualization of the postoperative patient’s face, the method may include enabling the user to modify the Input Data; and
在至少一个实施例中，在人工智能引擎模块生成术后患者面部的可视化后，该方法可包括使用户能够修改输入数据；以及
generating a modified visualization of the postoperative patient’s face through the Visualization module, based on modification of the Input Data by the user.
根据用户对输入数据的修改，通过可视化模块生成修改后的术后患者面部可视化图像。
The method may further include enabling the user to modify the procedure plan; and generating a modified visualization of the postoperative patient’s face based on modification of the procedure plan.
该方法可进一步包括使用户能够修改手术计划；以及根据对手术计划的修改生成术后患者面部的修改可视化。
The method may further include creating a visualization of a preoperative patient’s face by use of generated surgical markings overlaid on top of the preoperative patient’s face as created by the AI Engine module.
该方法可进一步包括通过使用人工智能引擎模块在术前患者面部上方叠加生成的手术标记，创建术前患者面部的可视化。
After the step of generating the visualization of the postoperative patient’s face, the at least one computer processor may be configured to enable the user to modify the postoperative patient’s face; and wherein the at least one computer processor is configured to generate a modified procedure plan based on the modification of the postoperative patient’s face.
在生成术后患者面部可视化的步骤之后，至少一个计算机处理器可被配置为使用户能够修改术后患者的面部；其中至少一个计算机处理器被配置为根据术后患者面部的修改生成修改后的手术计划。
In at least one embodiment, after the AI Engine module generates the visualization of the postoperative patient’s face, the at least one computer processor is configured to enable the user to modify the postoperative patient’s face; wherein the at least one computer processor is configured to generate a modified procedure plan based on the modification of the postoperative patient’s face.
在至少一个实施例中，在人工智能引擎模块生成术后患者面部的可视化之后，至少一个计算机处理器被配置为使用户能够修改术后患者的面部；其中，至少一个计算机处理器被配置为根据术后患者面部的修改生成修改后的手术计划。
In at least one embodiment, after the step of generating the visualization of the postoperative patient’s face, the method may include enabling the user to modify the postoperative patient’s face; and generating a modified procedure plan based on the modification to the postoperative patient’s face.
在至少一个实施例中，在生成术后患者面部可视化的步骤之后，该方法可包括使用户能够修改术后患者的面部；以及根据对术后患者面部的修改生成修改后的手术计划。
After the AI Engine module generates the visualization of the postoperative patient’s face, the method may include enabling the user to modify the postoperative patient’s face; and generating a modified procedure plan based on the modification of the postoperative patient’s face.
在人工智能引擎模块生成术后患者面部的可视化后，该方法可包括让用户修改术后患者的面部；以及根据对术后患者面部的修改生成修改后的手术计划。
Brief Description of the Drawings
图纸简介
Fig. 1 is a simplified block diagram of components of a system, method, and/or apparatus of at least one embodiment of the present invention;
图 1 是本发明至少一个实施例的系统、方法和/或装置的组件简化框图；
Fig. 2A is a first part of a flow chart of a first method or process in accordance with at least one embodiment of the present invention;
图 2A 是根据本发明至少一个实施方案的第一种方法或流程图的第一部分；
Fig. 2B is a second part of the flow chart of the first method;
图 2B 是第一种方法流程图的第二部分；
Fig. 3 is a flow chart of a second method or process in accordance with at least one embodiment of the present invention;
图 3 是根据本发明至少一个实施例的第二种方法或流程的流程图；
Fig. 4 is a flow chart of a third method or process in accordance with at least one embodiment of the present invention;
图 4 是根据本发明至少一个实施方案的第三种方法或流程的流程图；
Detailed Description of the Invention
发明详述
Fig. 1 is a simplified block diagram 1 of components of a system, method, and/or apparatus of at least one embodiment of the present invention.
图 1 是本发明至少一个实施例的系统、方法和/或装置的组件简化框图 1。
The components in block diagram 1 includes computer memory 2, Visualization module 4, a user computer processor 6, Input module 8, Artificial Intelligence (hereinafter “AI”) Engine module 10, optionally, server computing system 12, and marking device 22. The server computing system 12 includes one or more server computing device(s) 14 each of which includes one or more server computer processor(s) 16, one or more server computer memories 18, and one or more AI Engine module(s) 20. Each of the one or more AI Engine module(s) 20 may include one or more AI Engine model(s) 21. Each of the one or more AI Engine module(s)10 may include one or more AI Engine model(s)11.
框图 1 中的组件包括计算机存储器 2、可视化模块 4、用户计算机处理器 6、输入模块 8、人工智能（以下简称 "AI"）引擎模块 10，以及服务器计算系统 12 和标记设备 22。服务器计算系统 12 包括一个或多个服务器计算设备 14，每个设备包括一个或多个服务器计算机处理器 16、一个或多个服务器计算机存储器 18 和一个或多个人工智能引擎模块 20。一个或多个人工智能引擎模块 20 中的每个模块可包括一个或多个人工智能引擎模型 21。一个或多个人工智能引擎模块 10 中的每个模块可包括一个或多个人工智能引擎模型 11。
The computer memory 2 and 18 may be any form of computer and/or electronic memory. Each of the Visualization module 4, the Input module 8, the AI Engine module 10, and the AI Engine module 20 may include or may be computer software which is stored in computer memory 2 and/ or 18, and/or some other computer memory, and which is implemented by the user computer processor 6 and/or server computer processor 16.
计算机存储器 2 和 18 可以是任何形式的计算机和/或电子存储器。可视化模块 4、输入模块 8、人工智能引擎模块 10 和人工智能引擎模块 20 中的每个模块都可以包括或可以是计算机软件，这些软件存储在计算机存储器 2 和/或 18 和/或其他计算机存储器中，并由用户计算机处理器 6 和/或服务器计算机处理器 16 执行。
The Input module 8, may be, or may include, for example, a computer, phone or tablet touch screen, a computer keyboard, a three dimensional scanner, camera or other such image or video capturing device, and/or a computer mouse.
例如，输入模块 8 可以是或可以包括电脑、手机或平板电脑触摸屏、电脑键盘、三维扫描仪、摄像头或其他此类图像或视频捕捉设备，和/或电脑鼠标。
Fig. 2A is a first part 100a of a flow chart of a first method or process in accordance with at least one embodiment of the present invention.
图 2A 是根据本发明至少一个实施例的第一种方法或流程的流程图的第一部分 100a。
At step 102, Input Data which may include at least one of the following: patient data including the type of surgery, media such as images or videos, medical imaging, patient information, demographics and medical history, and desired results are input into the Input module 8 for transfer into the AI Engine module 10 and/or 20 as implemented by the computer processor 6 and/or 16 in accordance with computer programming stored in computer memory 2 and/or 18.
在第 102 步，输入数据可包括以下至少一项：患者数据（包括手术类型）、图像或视频等媒体、医学成像、患者信息、人口统计学和病史以及预期结果，这些数据被输入到输入模块 8 中，以便由计算机处理器 6 和/或 16 根据存储在计算机存储器 2 和/或 18 中的计算机编程，将这些数据传输到人工智能引擎模块 10 和/或 20 中。
At step 104, the AI Engine module 10 is programmed to process the Input Data provided from step 102, along with additional datasets to analyze facial anatomy, proportions, symmetry, and other relevant metrics. Based on this analysis, precise surgical markings, injection plans or procedure plans tailored to the patient's anatomy and procedure goals are generated by the AI Engine module 10, in accordance with computer software stored in AI Engine module 10 and/or computer memory 2 as implemented by AI Engine module 10 and/or user computer processor 6.
在步骤104，人工智能引擎模块10被编程处理步骤102提供的输入数据以及其他数据集，以分析面部解剖、比例、对称性和其他相关指标。在此分析的基础上，人工智能引擎模块 10 会根据存储在人工智能引擎模块 10 和/或计算机存储器 2 中的计算机软件，生成适合患者解剖结构和手术目标的精确手术标记、注射计划或手术计划，由人工智能引擎模块 10 和/或用户计算机处理器 6 执行。
At step 106 three dimensional visualizations are generated of the patient's face, the patient's face with overlaid surgical markings, injection plans or procedure plans, and/or the patient's face post-operation as predicted by the AI Engine module 10 and/or Visualization module 4 as programmed by computer software stored in module 4 and/or computer memory 2, and implemented by module 4 and/or user computer processor 6.
在第 106 步，根据人工智能引擎模块 10 和/或可视化模块 4 的预测，生成病人面部的三维可视化图像、病人面部与叠加的手术标记、注射计划或手术计划的三维可视化图像和/或病人面部手术后的三维可视化图像，人工智能引擎模块 10 和/或可视化模块 4 由存储在模块 4 和/或计算机存储器 2 中的计算机软件编程，并由模块 4 和/或用户计算机处理器 6 执行。
In at least one embodiment, step 106 may occur before step 104. In this embodiment, at step 106, the AI Engine module 10 is programmed to process the Input Data provided from step 102, along with additional datasets to analyze facial anatomy, proportions, symmetry, and other relevant metrics. Based on this analysis, three dimensional visualizations are generated of the patient's face and/or the patient's face post-operation as predicted by the AI Engine module 10 and/or Visualization module 4 as programmed by computer software stored in module 4 and/or computer memory 2, and implemented by module 4 and/or user computer processor 6.
在至少一个实施例中，步骤 106 可以发生在步骤 104 之前。在此实施例中，在步骤 106，人工智能引擎模块 10 被编程为处理步骤 102 提供的输入数据以及其他数据集，以分析面部解剖、比例、对称性和其他相关指标。根据分析结果，按照人工智能引擎模块10和/或可视化模块4的预测，生成患者面部和/或患者手术后面部的三维可视化图像，这些图像由存储在模块4和/或计算机存储器2中的计算机软件编程，并由模块4和/或用户计算机处理器6实现。
Subsequently, at step 104, the AI Engine module 10 is programmed to process the Input Data provided from step 102, the predicted patient’s face in step 106, and additional relevant datasets. Based on this analysis, precise surgical markings, injection plans or procedure plans tailored to the patient's anatomy and procedure goals are generated by the AI Engine module 10 in order to achieve the results as shown in the predicted patient’s face in step 106, in accordance with computer software stored in AI Engine module 10 and/or computer memory 2 as implemented by AI Engine module 10 and/or user computer processor 6.
随后，在步骤104，人工智能引擎模块10被编程处理步骤102提供的输入数据、步骤106中预测的患者面部以及其他相关数据集。在此分析的基础上，人工智能引擎模块 10 根据存储在人工智能引擎模块 10 和/或计算机存储器 2 中的计算机软件，生成适合患者解剖结构和手术目标的精确手术标记、注射计划或手术计划，以实现步骤 106 中预测的患者面部所示的结果，这些结果由人工智能引擎模块 10 和/或用户计算机处理器 6 实现。
At step 108, plan review and modification take place. The user may review the results provided by the Visualization module 4 at step 106. The visualization module 4 may include a monitor such as a computer monitor and/or tablet or phone display.
在步骤 108，进行计划审查和修改。用户可在步骤 106 审查可视化模块 4 提供的结果。可视化模块 4 可包括一个显示器，如计算机显示器和/或平板电脑或手机显示屏。
The Input module 8 and/or computer software for the Input module 8 is configured to allow a user to make changes to the Input Data and surgical marking, injection plans, or procedure plans in real-time by the user through the Input module 8 and the results of the changes are configured to be regenerated and displayed dynamically by the Visualization module 4.
输入模块 8 和/或输入模块 8 的计算机软件被配置为允许用户通过输入模块 8 对输入数据和手术标记、注射计划或手术计划进行实时更改，更改结果被配置为由可视化模块 4 动态再生和显示。
Alternatively, one or more embodiments of the present invention permit a user to make changes in real-time to the desired results as shown on the patient's face post-operation, and the surgical marking, injection plans, or procedure plans are configured to be regenerated and displayed dynamically by the Visualization module 4 according to the changes in the desired results.
另外，本发明的一个或多个实施例允许用户对手术后患者面部显示的预期效果进行实时更改，手术标记、注射计划或手术计划被配置为由可视化模块4根据预期效果的变化动态地再生和显示。
As indicated by Step 110, if the user has made changes to the plan and/or the desired results, then the procedure loops back to step 106.
如步骤 110 所示，如果用户对计划和/或预期结果进行了更改，则程序将返回步骤 106。
If the user intends to finalize plans, at step 110, then the procedure next flows to node A, which flows to step 112 on flow chart part 100b, shown in Fig. 2B.
如果用户打算在步骤 110 最终确定计划，那么程序接下来将流向节点 A，即流向流程图部件 100b 的步骤 112，如图 2B 所示。
At step 112, the user is able to finalize plans by approving surgical markings, injection plans or procedures plans, such as by user input into the Input module 8, in accordance with computer software, for example, stored in the Input module 8, and/or in the computer memory 2.
在第 112 步，用户可以根据例如存储在输入模块 8 和/或计算机存储器 2 中的计算机软件，通过批准手术标记、注射计划或程序计划，例如通过用户输入输入模块 8，最终确定计划。
At step 114, the Input module 8 and/or the computer memory 2 is optionally programmed with computer software to allow a user to upload postoperative results at predefined time intervals such by uploading images and/or video of the patient's face immediately after surgery, one week after surgery, and one to three months after surgery. The Input module 8 and/or the computer memory 2 is optionally programmed to allow users to grade how close the results align with the AI model generated predictions provided by the AI Engine module 10 and provide additional feedback to the AI Engine module 10, through the Input module 8. The AI Engine module 10 may be programmed by computer software to use this feedback to further refine the models.
在步骤114，输入模块8和/或计算机存储器2可选地编程为计算机软件，以允许用户在预定义的时间间隔上传术后结果，例如在术后立即、术后一周以及术后一至三个月上传患者面部的图像和/或视频。输入模块 8 和/或计算机存储器 2 可以选择编程，允许用户对结果与人工智能引擎模块 10 提供的人工智能模型生成的预测结果的一致程度进行评分，并通过输入模块 8 向人工智能引擎模块 10 提供额外的反馈。人工智能引擎模块 10 可通过计算机软件编程，利用这些反馈进一步完善模型。
Fig. 3 is a flow chart 200 of a second method or process in accordance with at least one embodiment of the present invention.
图 3 是根据本发明至少一个实施例的第二种方法或流程的流程图 200。
At step 202, Input Data which may include at least one of the following: patient data including the type of surgery, media such as images or videos, medical imaging, patient information, demographics and medical history, and desired results are input into the AI Engine module 10 using the Input module 8, as implemented by the user computer processor 6 in accordance with computer programming stored in computer memory 2. The AI Engine module 10 and/or the Input module 8, in at least one embodiment are further programmed by computer software to receive additional information input such as manually generated surgical markings, injection plans or procedure plans.
在步骤 202，用户计算机处理器 6 根据存储在计算机存储器 2 中的计算机编程，使用输入模块 8 将输入数据输入人工智能引擎模块 10，输入数据可包括以下至少一项：包括手术类型在内的患者数据、图像或视频等媒体、医学成像、患者信息、人口统计学和病史以及预期结果。在至少一个实施例中，人工智能引擎模块 10 和/或输入模块 8 由计算机软件进一步编程，以接收额外的信息输入，如手动生成的手术标记、注射计划或手术计划。
At step 204, the AI Engine module 10 is programmed to process the data provided from step 202, and user inputs of manual markings, injection plans or procedure plans to analyze facial anatomy, proportions, symmetry, and other relevant metrics. Based on this input and analysis by the AI Engine module 10, as programmed by computer software, recommended modifications to the manual markings or plans are generated by the AI Engine module 10.
在步骤 204，人工智能引擎模块 10 被编程处理步骤 202 提供的数据以及用户输入的手动标记、注射计划或手术计划，以分析面部解剖、比例、对称性和其他相关指标。根据计算机软件编程的人工智能引擎模块 10 的输入和分析，人工智能引擎模块 10 会生成对手动标记或计划的建议修改。
At step 206 three dimensional visualizations of the patient's face, the patient's face with overlaid surgical markings, injection plans or procedure plans, as input by the user through Input module 8, and/or the patient's face post-operation as predicted by the user input surgical markings, injection plans or procedure plans are generated by the AI Engine module 10, in accordance with computer programming, and displayed to the user by Visualization module 4. In addition, the patient's face with overlaid surgical markings, injection plans or procedure plans as determined by the AI Engine module 10, in accordance with computer programming, and recommended modifications, and the patient's face post-operation as predicted by the recommended modifications are generated by the AI Engine module 10 are displayed to the user by Visualization module 4 in accordance with computer programming.
在步骤 206，由人工智能引擎模块 10 根据计算机编程生成病人面部的三维可视化图像、由用户通过输入模块 8 输入的带有叠加手术标记、注射计划或手术计划的病人面部和/或由用户输入的手术标记、注射计划或手术计划预测的手术后病人面部，并由可视化模块 4 显示给用户。此外，由人工智能引擎模块 10 根据计算机编程确定的叠加手术标记、注射计划或手术计划的患者面部和建议的修改，以及由人工智能引擎模块 10 根据计算机编程生成的由建议的修改预测的患者手术后面部，由可视化模块 4 显示给用户。
At step 208 plan review and modification takes place. The user may review the results provided by using the Visualization module 4 at step 206. The Visualization module 4 may include a computer monitor.
在步骤 208，将对计划进行审查和修改。用户可在步骤 206 使用可视化模块 4 查看所提供的结果。可视化模块 4 可包括一个计算机显示器。
Input Data from the user provided through Input module 8 and surgical markings, injection plans or procedure plans modifications including acceptance, alteration or rejection of the AI recommended modifications, provided by AI Engine module 10, in at least one embodiment, are configured to be made in real-time and the results of the modifications are configured to be displayed dynamically using the Visualization module 4.
在至少一个实施例中，用户通过输入模块 8 提供的输入数据和人工智能引擎模块 10 提供的手术标记、注射计划或手术计划修改，包括接受、更改或拒绝人工智能建议的修改，都被配置为实时进行，修改结果被配置为使用可视化模块 4 动态显示。
In at least one embodiment, computer software is provided, such as for the AI Engine module 10 and/or the user computer processor 6, which allows the user to modify the surgical markings, injection plans or procedure plans to change the predicted results by use of the Input module 8, or modify the predicted results by use of the Input module 8, in order to change the surgical markings, injection plans or procedure plans.
在至少一个实施例中，提供了计算机软件，例如用于人工智能引擎模块 10 和/或用户计算机处理器 6 的软件，允许用户通过使用输入模块 8 修改手术标记、注射计划或手术计划，以改变预测结果，或通过使用输入模块 8 修改预测结果，以改变手术标记、注射计划或手术计划。
As indicated by Step 210, if the user has made changes to the plan then the procedure loops back to step 206.
如步骤 210 所示，如果用户对计划进行了更改，程序将返回步骤 206。
If the user intends to finalize plans, at step 210, then the procedure next flows to step 212 shown in Fig. 3.
如果用户打算在步骤 210 最终确定计划，那么程序接下来将进入图 3 所示的步骤 212。
At step 212, in at least one embodiment, the user can finalize plans by approving the surgical markings, injection plans or procedure plans by providing Input Data to the Input module 8, which is then processed by the user computer processor 6 and an indication of approval is stored in computer memory 2, and/or displayed on a computer monitor of Visualization module 4.
在步骤 212，至少在一个实施例中，用户可以通过向输入模块 8 提供输入数据，批准手术标记、注射计划或程序计划，从而最终确定计划，然后由用户计算机处理器 6 进行处理，并将批准指示存储在计算机存储器 2 中，和/或显示在可视化模块 4 的计算机显示器上。
Fig. 4 shows a flow chart 300 of a third method or process in accordance with at least one embodiment of the present invention.
图 4 显示了根据本发明至少一个实施例的第三种方法或流程的流程图 300。
At step 302, Input Data which may include at least one of the following: patient data including the type of surgery, media such as images or videos, medical imaging, patient information, demographics and medical history, and desired results are input into the Input module 8 for transfer into the AI Engine module 10 as implemented by the user computer processor 6 in accordance with computer programming stored in computer memory 2.
在步骤 302，输入数据（可包括以下至少一项）被输入到输入模块 8 中，以便由用户计算机处理器 6 根据存储在计算机内存 2 中的计算机程序将其传输到人工智能引擎模块 10 中。
At step 304, the AI Engine module 10 is programmed to process the Input Data provided from step 302, along with additional datasets to analyze facial anatomy, proportions, symmetry, and other relevant metrics. Based on this analysis, at least two different three dimensional visualization versions of the patient’s face post-operation as predicted by the AI Engine module 10 are generated based on the patient’s desired results and the at least two versions are displayed to the user. The AI Engine module 10 may provide a number of alternative visualizations of the patient’s face post-operation based on factors including but not limited to model training based on previous procedures, user input desired results, feasibility of the procedure and risk factors based in part on the Input Data.
在步骤 304，人工智能引擎模块 10 被编程处理步骤 302 提供的输入数据以及其他数据集，以分析面部解剖、比例、对称性和其他相关指标。在此分析的基础上，根据患者的预期效果生成人工智能引擎模块 10 预测的患者手术后面部的至少两个不同的三维可视化版本，并将至少两个版本显示给用户。人工智能引擎模块 10 可根据包括但不限于基于先前手术的模型训练、用户输入的预期结果、手术的可行性以及部分基于输入数据的风险因素等因素，提供患者手术后面部的多个可选可视化版本。
At step 306, the user computer processor 6 and/or the AI Engine modules 10 and/or 20 are programmed to allow, the user to select one of the versions of the patient’s face post-operation to proceed. The version selected typically is the version that best aligns with the patient’s expectations considering results, risk factors, feasibility, recover time, and any other such factors.
在步骤 306，对用户计算机处理器 6 和/或人工智能引擎模块 10 和/或 20 进行编程，以允许用户从患者手术后的面部版本中选择一个进行手术。所选版本通常是考虑到效果、风险因素、可行性、恢复时间和任何其他此类因素，最符合患者期望的版本。
At step 308, the AI Engine module 10 and/or 20 is programmed to process the Input Data provided from step 302, along with additional datasets to analyze facial anatomy, proportions, symmetry, other relevant metrics, and version selected in step 306 to generate precise surgical markings, injection plans or procedure plans that will achieve the results shown in the version selected. Optionally, the generation of the surgical markings, injection plans or procedure plans may occur at step 304 for each version of the patient’s face post-operation shown, prior to the user selecting one of the versions. At step 308 the AI Engine module 10 and/or 20 is programmed to generate procedure plans and to store these plans in computer memory, such as memory 2, and/or display on visualization module 4. The AI Engine module 10 and/or 20 is programmed to generate these procedure plans based on and/or tailored to the Input Data and the version of the results that the user has selected through Input module 8.
在步骤 308，对人工智能引擎模块 10 和/或 20 进行编程，以处理从步骤 302 提供的输入数据以及其他数据集，从而分析面部解剖、比例、对称性、其他相关指标以及在步骤 306 中选择的版本，以生成精确的手术标记、注射计划或手术计划，从而实现所选版本中显示的效果。可选地，在用户选择其中一个版本之前，手术标记、注射计划或手术计划的生成可在步骤 304 中针对所显示的患者面部手术后的每个版本进行。在步骤 308，对人工智能引擎模块 10 和/或 20 进行编程，以生成手术计划，并将这些计划存储在计算机存储器（如存储器 2）中，和/或显示在可视化模块 4 上。人工智能引擎模块10和/或20被编程为根据输入数据和用户通过输入模块8选择的结果版本生成和/或定制这些程序计划。
At step 310, optionally, three dimensional visualizations of the patient's face, the patient's face with overlaid surgical markings, injection plans or procedure plans, and/or the patient's face post-operation are generated by the AI Engine module 10 and/or 20 and stored in computer memory 2 and/or displayed on visualization module 4, in accordance with programming for the AI Engine module 10 and/or 20. These three dimensional visualizations are predicted by the AI Engine module 10 and/or 20 in accordance with programming for the AI Engine module 10 and/or 20, based on the surgical markings, injection plans or procedure plans, and these three dimensional visualizations are generated by the AI Engine module 10 and/or 20 and stored in computer memory 2 and/or displayed to the user by the visualization module 4 in accordance with programming of the AI Engine modules 10 and/or 20.
在步骤310，可选地，根据人工智能引擎模块10和/或20的编程，由人工智能引擎模块10和/或20生成患者面部的三维可视化、叠加手术标记的患者面部、注射计划或手术计划和/或手术后患者面部的三维可视化，并存储在计算机存储器2中和/或显示在可视化模块4上。这些三维可视化效果由人工智能引擎模块10和/或20根据手术标记、注射计划或手术计划，按照人工智能引擎模块10和/或20的编程进行预测，这些三维可视化效果由人工智能引擎模块10和/或20生成，并按照人工智能引擎模块10和/或20的编程存储在计算机存储器2中和/或由可视化模块4显示给用户。
Optionally, the procedure may next flow from step 310 to node B, which flows to step 108 on flow chart part 100a, shown in Fig. 2A.
可选地，程序接下来可从步骤 310 流向节点 B，节点 B 流向图 2A 所示流程图部件 100a 上的步骤 108。
Otherwise, at step 312, one or more of the computer processor 6, and/or the AI Engine modules 10 and/or 20 are programmed to allow the user to be able to finalize plans by approving surgical markings, injection plans or procedures plans, such as by user input into the Input module 8, in accordance with computer software, for example, stored in one or more of the Input module 8, the computer memory 2, and/or the AI Engine modules 10 and/or 20.
否则，在步骤312，计算机处理器6和/或人工智能引擎模块10和/或20中的一个或多个被编程为允许用户能够通过批准手术标记、注射计划或程序计划来最终确定计划，例如通过用户输入到输入模块8，根据计算机软件，例如，存储在输入模块8、计算机内存2和/或人工智能引擎模块10和/或20中的一个或多个中的计算机软件。
One or more embodiments of the present invention include a process executed by one or more computer processors and/or AI Engine modules 10 and/or 20, comprising the following steps:
本发明的一个或多个实施例包括由一个或多个计算机处理器和/或人工智能引擎模块10和/或20执行的流程，包括以下步骤：
(1) Patient Data Acquisition: Input of Input Data through Input module 8 which may include at least one of the following: the desired procedure and patient-specific data such as 3D facial scans, media such as photographs or videos, medical imaging (e.g., CT scans, MRI, X-rays, ultrasounds etc.), demographics (age, sex, race, etc.), medical history including previous surgeries, allergies, drug use, and other relevant factors such as risk factors, recovery time preference, height, weight, body fat percentage, and patient desired results. Desired results may be input as specific amounts of tissue removal at particular points, length measurements between points or degree of repositioning, volume or mass to be added or subtracted from specific locations, or description of desired end results such as facial symmetry or reduced wrinkles. As an example, in upper blepharoplasty, the input may consist of patient’s desire to remove excess skin and fat from the upper eyelids. This can be input as numerical values such as area or volume of skin or fat to remove from specific regions, or generalized desired outcome of the surgery such as removal of a double eyelid or desired symmetry between eyes. The Input Data may be pre-processed by standardizing the collected data and making sure the formatting is consistent. Image processing techniques may be used to enhance, segment, and extract key elements from input media such as images or videos.
(1) 患者数据采集：通过输入模块 8 输入输入数据，其中可包括以下至少一项：所需的手术和患者特定数据，如 3D 面部扫描、照片或视频等媒体、医学成像（如 CT 扫描、核磁共振成像、X 光、超声波等）、人口统计学（年龄、性别、种族等）、病史（包括以前的手术、过敏史、药物使用史）以及其他相关因素，如风险因素、恢复时间偏好、身高、体重、体脂百分比和患者所需的结果。预期效果可以输入特定点的具体组织切除量、点之间的长度测量值或重新定位的程度、特定位置需要增加或减少的体积或质量，或对预期最终效果的描述，如面部对称或皱纹减少。例如，在上眼睑整形术中，输入的信息可能包括病人希望去除上眼睑多余皮肤和脂肪的愿望。输入的数据可以是数值，如需要从特定区域去除的皮肤或脂肪的面积或体积，也可以是概括的手术预期效果，如去除双眼皮或两眼对称。输入数据可通过标准化收集的数据进行预处理，并确保格式一致。图像处理技术可用于增强、分割和提取输入媒体（如图像或视频）中的关键元素。
(2) Integration of various AI models, such as by one or more of AI Engine module 10 and/or 20, to analyze patient-specific data such as the patient’s facial anatomy including distribution of skin, muscle, and fat, evaluation of key indicators such as facial proportions, symmetry, and skin elasticity, and desired results. Additional information to be analyzed may include datasets such as facial recognition of other members of the patient demographics, procedure plans such as surgical markings and injection plans, results of previously performed procedures, relevant anatomic models such as bone, blood vessel and nerve mapping, and default results criteria based on the procedure selected.
(2)整合各种人工智能模型，例如由人工智能引擎模块10和/或20中的一个或多个进行整合，以分析患者的特定数据，例如患者的面部解剖结构，包括皮肤、肌肉和脂肪的分布，评估面部比例、对称性和皮肤弹性等关键指标，以及预期效果。要分析的其他信息可包括数据集，如患者人口统计中其他成员的面部识别、手术计划（如手术标记和注射计划）、先前执行的手术结果、相关解剖模型（如骨骼、血管和神经映射）以及基于所选手术的默认结果标准。
(3) Automatic generation of procedure plans, in accordance with computer programming, such as by AI Engine module 10 and/or 20, such as precise surgical markings, injection plans, or procedure plans tailored to the patient’s unique facial anatomy and the desired outcomes. Multiple alternative plans may be generated by the AI Engine modules 10 and/or 20 and stored in computer memory 2, and displayed on visualization module 4, for user consideration based on risk factors, feasibility, recovery time, and expected results. For example, medical imaging of the patient may be used as part of the Input Data which the AI Engine module 10 may consider in generating procedure plans that avoid damaging critical anatomical features such as bone structure, blood vessels, or nerves by adjusting injection location, angle, depth and needle gauge and alternative plans may be generated based in part on the user’s risk tolerance or recovery time.
(3)根据计算机编程自动生成手术计划，例如由人工智能引擎模块10和/或20自动生成，如精确的手术标记、注射计划或根据患者独特的面部解剖结构和预期效果量身定制的手术计划。人工智能引擎模块 10 和/或 20 可以根据风险因素、可行性、恢复时间和预期效果生成多个备选计划，并存储在计算机存储器 2 中，显示在可视化模块 4 上，供用户考虑。例如，病人的医学影像可作为输入数据的一部分，人工智能引擎模块 10 在生成程序计划时可考虑这些数据，通过调整注射位置、角度、深度和针规，避免损坏关键的解剖特征，如骨骼结构、血管或神经。
(4) Generation of 3D visualizations of the patient’s face, such as through Visualization module 4, by one or more of computer processor 6, AI Engine modules 10 and/or 20, in accordance with computer software programming, and/or visualization of the patient’s face with overlaid procedure plans such as surgical markings and / or injection plans, and the post-operative patient’s face as predicted by the procedure plans such as surgical markings and / or injection plans. In at least one embodiment, multiple versions of the post-operative patient’s face may be generated based on AI Engine 10 and/or 20 training in part on previous procedures, risk factors, feasibility, recover time, patient desired results and any other such factors. In at least one embodiment the visualization of step (4) may be generated prior to the procedure plans.
(4)生成患者面部的三维可视化，例如通过可视化模块4，由计算机处理器6、人工智能引擎模块10和/或20中的一个或多个根据计算机软件编程生成，和/或将患者面部与重叠的手术计划（如手术标记和/或注射计划）以及手术计划（如手术标记和/或注射计划）预测的术后患者面部可视化。在至少一个实施例中，可根据人工智能引擎 10 和/或 20 部分基于先前手术、风险因素、可行性、恢复时间、患者期望结果和任何其他此类因素的训练，生成多个版本的术后患者面部。在至少一个实施例中，步骤（4）的可视化可在手术计划之前生成。
(5) A user interface (UI), such as including Input module 8 and/or Visualization module 4, that allows users to review, adjust, and approve the AI-generated procedure plans such as surgical markings or injection plans, and/or in combination with AI Engine module 10 and/or 20 in accordance with computer software programming. In at least one embodiment, users may be able adjust Input Data or make modifications to the procedure plans such as the surgical markings and / or injection plans, through input module 8, in accordance with software programming in computer processor 6, and/or AI Engine Modules 10 and/or 20, in order to achieve the desired results. In at least one embodiment, users may be able to view and adjust alternative plans generated by AI Engine module 10 and/or 20, and displayed on Visualization module 4, and/or stored in computer memory 2, based on risk factors, desired results, or other such factors.
(5)用户界面(UI)，例如包括输入模块8和/或可视化模块4，允许用户审查、调整和批准人工智能生成的手术计划，如手术标记或注射计划，和/或根据计算机软件编程与人工智能引擎模块10和/或20相结合。在至少一个实施例中，用户可以根据计算机处理器 6 和/或人工智能引擎模块 10 和/或 20 中的软件编程，通过输入模块 8 调整输入数据或修改手术标记和/或注射计划等手术计划，以达到预期效果。在至少一个实施例中，用户可以根据风险因素、预期效果或其他此类因素，查看和调整由人工智能引擎模块 10 和/或 20 生成并显示在可视化模块 4 上和/或存储在计算机存储器 2 中的备选计划。
(6) In at least one embodiment, dynamic feedback capabilities, are provided, such as through Input module 8, Visualization module 4, and AI Engine modules 10 and/or 20, that enable real-time regeneration of realistic results on Visualization module 4 and/or in computer memory, such as computer memory 2, based on user changes. When users modify Input Data or surgical, injection, or procedure plans, through visualization module 4, and/or in computer memory 2, the system, including one or more of AI Engine modules 10 and/or 20, is programmed to recalculate and update the visualization in real-time in computer memory 2 and to display on Visualization module 4, to reflect the new parameters, ensuring the plan remains precise and adaptable and providing immediate feedback in response to the changing inputs.
(6)在至少一个实施例中，通过输入模块 8、可视化模块 4 和人工智能引擎模块 10 和/或 20 等提供动态反馈功能，可根据用户更改在可视化模块 4 和/或计算机内存（如计算机内存 2）中实时再生现实结果。当用户通过可视化模块 4 和/或计算机存储器 2 修改输入数据或手术、注射或程序计划时，包括一个或多个人工智能引擎模块 10 和/或 20 在内的系统会进行编程，以重新计算和实时更新计算机存储器 2 中的可视化结果，并显示在可视化模块 4 上，以反映新的参数，确保计划保持精确性和适应性，并根据输入的变化提供即时反馈。
(7) Once satisfied, the plans are finalized and saved in computer memory, such as computer memory 2, of the system.
(7)满足要求后，计划将被最终确定并保存在系统的计算机存储器（如计算机存储器 2）中。
(8) Optionally, ability to scan a user’s procedure plans such as manual surgical markings via photo or video, such as through Input module 8, analyze the Input Data, such as by AI Engine module 10 and/or 20, provide visualization of the predicted results, such as by Visualization module 4, and suggest improvements to the procedure plans such as surgical markings such as through visualization module 4 and/or as stored in computer memory 2. Alternatively, the ability for a user to input through Input module 8, procedure plans such as injection plans including placement, depth, and volume via UI or photo or video, analyze the input data, provide visualization through Visualization module 4, of the results, and suggest improvements to the procedure plans such as injection plans via AI Engine modules 10 and/or 20.
(8)可选地，能够通过照片或视频扫描用户的手术计划，如手动手术标记，如通过输入模块8，分析输入数据，如通过人工智能引擎模块10和/或20，提供预测结果的可视化，如通过可视化模块4，并对手术计划提出改进建议，如通过可视化模块4和/或存储在计算机内存2中的手术标记。或者，用户能够通过输入模块 8 输入手术计划，如通过用户界面或照片或视频输入包括位置、深度和体积在内的注射计划，分析输入数据，通过可视化模块 4 提供可视化结果，并通过人工智能引擎模块 10 和/或 20 对手术计划提出改进建议，如注射计划。
(9) Optionally, in at least one embodiment, any one of Input module 8, computer processor 6, AI Engine modules 10 or 20 may be programmed by computer software to allow postoperative results to be uploaded by means of Input module 8 to AI Engine module 10 or 20, at defined time intervals such as immediately after surgery, one week after surgery, and three months after surgery to further refine the AI model of the AI Engine module 10 and/or 20. In at least one embodiment, the AI Engine modules 10 or 20 are programmed to record results, in computer memory 2 in the form of photographs, videos, 3D facial scans, and medical imaging or as numerical values. In at least one embodiment, users are able grade, through programming of AI Engine module 10 and/or 20, and/or by using Input module 8, how close the results align with the model-generated predictions, provide specific feedback on any deviation, and document in computer memory 2, extenuating circumstances that may have affected outcomes.
(9)可选地，在至少一个实施例中，输入模块8、计算机处理器6、人工智能引擎模块10或20中的任何一个可通过计算机软件编程，以允许在规定的时间间隔，如手术后立即、手术后一周和手术后三个月，通过输入模块8将术后结果上传到人工智能引擎模块10或20，以进一步完善人工智能引擎模块10和/或20的人工智能模型。在至少一个实施例中，人工智能引擎模块 10 或 20 被编程为以照片、视频、三维面部扫描和医学影像的形式或以数值的形式在计算机存储器 2 中记录结果。在至少一个实施例中，用户可以通过对人工智能引擎模块 10 和/或 20 进行编程，和/或使用输入模块 8，对结果与模型生成的预测的接近程度进行评分，对任何偏差提供具体反馈，并在计算机存储器 2 中记录可能影响结果的情有可原的情况。
(10) Optionally during steps (5) or (6), the computer processor 6 and/or AI Engine modules 10 and/or 20 may be programmed with computer software to allow a user, through Input module 8, to adjust the AI-generated results provided by AI Engine module 10, of the post-operative patient’s face in order to regenerate an image of the patient’s face with procedure plans such as surgical markings or injection plans overlaid, on the Visualization module 4, in accordance with programming of the computer processor 6 and/or AI Engine modules 10 and/or 20. The adjustments may be made by interacting with the Input module 8, , to change numerical values associated with various actions and regions of the procedure, or visually, through Visualization module 4, such as by selecting actions and clicking and dragging regions of the face or a slider bar using a mouse on a computer or using a finger on a tablet. In at least one embodiment, procedure plans are dynamically updated in real-time, in computer memory 2, in accordance with computer programming of the computer processor 6 and/or AI Engine modules 10 and/or 20, based on the user’s modifications (which in at least one embodiment are stored in computer memory 2) to the generated results of the post-operative patient’s face. In at least one embodiment, any user changes to the procedure plans or post-operative patient’s face and resulting changes to the AI Engine 10 generated post-operative patient’s face or procedure plans may be saved such as in computer memory 2 for recall and visualization such as for use in side-by-side comparisons.
(10) 在步骤(5)或(6)中，计算机处理器6和/或人工智能引擎模块10和/或20可选择性地使用计算机软件编程，以允许用户通过输入模块8调整人工智能引擎模块10提供的术后患者面部的人工智能生成结果，以便根据计算机处理器6和/或人工智能引擎模块10和/或20的编程，在可视化模块4上重新生成带有手术标记或注射计划等手术计划的患者面部图像。调整可以通过与输入模块 8 进行交互，改变与手术的各种操作和区域相关的数值，也可以通过可视化模块 4 可视化地进行调整，例如使用计算机上的鼠标或平板电脑上的手指选择操作并点击和拖动面部区域或滑动条。在至少一个实施例中，根据用户对术后患者面部生成结果的修改（在至少一个实施例中，这些修改存储在计算机存储器2中），按照计算机处理器6和/或人工智能引擎模块10和/或20的计算机编程，在计算机存储器2中实时动态更新手术计划。在至少一个实施例中，用户对手术计划或术后患者面部的任何修改，以及由此对人工智能引擎 10 生成的术后患者面部或手术计划的修改，都可以保存在计算机存储器 2 中，以便调用和可视化，例如用于并排比较。
(11) Optionally, the system may allow for multi-user collaboration, such as between a patient and doctor in which multiple users may jointly generate, review and modify parts of the system.
(11) 可选情况下，系统可允许多用户协作，例如病人和医生之间的协作，其中多个用户可共同生成、审查和修改系统的部分内容。
(12) Optionally, in at least one embodiment the marking device 22 is configured to to mark or draw the procedure plans such as surgical markings or injection plans on the actual patient’s face based on the procedure plans generated by the AI Engine 10 and/or 20. The marking device 22 may be a robotic arm or similar device that may automatically apply the procedure plans such as by directing a Sharpie without user or surgeon intervention, in accordance with software programming of the user computer processor 6, and/or AI engine modules 10 and/or 20. Alternatively, the marking device 22 may be configured to apply the markings by means of projecting light or laser(s) directly onto the patient’s face. This marking device 22 may be used at any point during the process after the procedure plans are generated.
(12）可选地，在至少一个实施例中，标记设备22被配置为根据人工智能引擎10和/或20生成的手术计划在实际患者面部标记或绘制手术计划，例如手术标记或注射计划。标记设备 22 可以是机械臂或类似设备，它可以根据用户计算机处理器 6 和/或人工智能引擎模块 10 和/或 20 的软件编程，自动应用手术计划，例如在没有用户或外科医生干预的情况下引导锐利笔。另外，标记设备 22 也可配置为通过将光线或激光直接投射到患者面部来应用标记。该标记设备 22 可在程序计划生成后的过程中的任何时候使用。
One or more embodiments of the present invention may use one or more computer software modules or components, which are stored in computer memory and are executed by a computer processor. The one or more computer software modules may include (a) the AI Engine computer software module 10 and/or 20, (b) the Input computer software module 8, and (c) the Visualization computer software module 4.
本发明的一个或多个实施例可使用一个或多个计算机软件模块或组件，这些模块或组件存储在计算机内存中，由计算机处理器执行。一个或多个计算机软件模块可包括：(a) 人工智能引擎计算机软件模块 10 和/或 20，(b) 输入计算机软件模块 8，以及 (c) 可视化计算机软件模块 4。
The AI Engine computer software module 10 and/or 20, in at least one embodiment, is programmed by computer software to:
在至少一个实施例中，人工智能引擎计算机软件模块 10 和/或 20 由计算机软件编程，以便：
(i) Utilize various types of AI models to generate surgical, injection or procedure plans based in part on user input information.
(i) 利用各类人工智能模型，部分根据用户输入的信息生成手术、注射或程序计划。
(ii) Utilize facial recognition models to identify, map and extract relevant biometric data such as measurements and patient specific conditions.
(ii) 利用面部识别模型来识别、映射和提取相关的生物识别数据，如测量值和病人的具体情况。
(iii) Utilize generative AI models to generate realistic three dimensional models of a patient’s face in real-time. The generative AI model may obtain information from the AI and facial recognition models to generate the pre-operative patient’s face, the pre-operative patient’s face with surgical or injection plans overlaid, and the predicted post-operative patient’s face.
(iii) 利用人工智能生成模型实时生成逼真的病人面部三维模型。生成式人工智能模型可从人工智能和面部识别模型获取信息，生成术前病人面部、叠加手术或注射计划的术前病人面部以及预测的术后病人面部。
(iv) AI models, facial recognition systems, and generative AI models are used in combination to accurately capture Input Data including patient data, predict best surgical markings, injection plans, procedure plans, and procedure outcome, and generate various realistic models of the patient’s face. Additional datasets such as anatomical models, best practices, previous patient results, etc. may be used in combination with Input Data or as a part of the training of the AI Models. In addition, the system allows for real-time visualization of the predicted results in response to user modifications to the input values, surgical, injection or procedure plans, and user desired results. The models used may include neural networks such as convolutional neural networks, machine learning such as supervised, unsupervised and deep learning, decision trees, generative AI, regression models, classifier models, and/or other such models, algorithms, and training techniques. The models may be trained on layers of comprehensive datasets including anatomical models, prior surgical and filler procedures and outcomes including media such as images or video of the patient before surgery and at various time intervals after surgery, surgical markings, injection plans, procedure plans, desired and satisfaction with results, genetics, demographics, and various other pertinent medical information. The models may be used independently or in conjunction with other models in sequential layers or in parallel.
(iv) 结合使用人工智能模型、面部识别系统和生成式人工智能模型，以准确捕捉包括患者数据在内的输入数据，预测最佳手术标记、注射计划、手术计划和手术结果，并生成患者面部的各种逼真模型。其他数据集，如解剖模型、最佳实践、以往病人的结果等，可与输入数据结合使用，或作为人工智能模型训练的一部分。此外，该系统还可根据用户对输入值、手术、注射或程序计划的修改以及用户期望的结果，对预测结果进行实时可视化。所使用的模型可包括神经网络（如卷积神经网络）、机器学习（如有监督、无监督和深度学习）、决策树、生成式人工智能、回归模型、分类器模型和/或其他此类模型、算法和训练技术。这些模型可以在多层综合数据集上进行训练，这些数据集包括解剖模型、先前的手术和填充程序及结果，包括手术前和手术后不同时间间隔的患者图像或视频等媒体、手术标记、注射计划、程序计划、预期结果和满意度、遗传学、人口统计学以及各种其他相关医疗信息。这些模型可单独使用，也可与其他模型按顺序层层叠加或并行使用。
(v) Optionally, one or more models of the AI Engine module 10 may be stored and trained on the server computing system 12 that communicates with the user computer processor 6. The server computing system 12 may include one or more server computing devices 14, where each may have a server computer processor 16, server computer memory 18 and AI Engine module 20. The server computing system 12 may receive information such as through the Input module 8 from the user computer processor 6 in order to run models, and communicate outputs to the user computer processor 6. In this manner the necessary computing power may be transferred from the user computer processor 6 to the server computing system 12.
(v) 可选地，人工智能引擎模块 10 的一个或多个模型可在与用户计算机处理器 6 通信的服务器计算系统 12 上存储和训练。服务器计算系统 12 可以包括一个或多个服务器计算设备 14，其中每个设备可以有一个服务器计算机处理器 16、服务器计算机存储器 18 和人工智能引擎模块 20。服务器计算系统 12 可以通过输入模块 8 等从用户计算机处理器 6 接收信息，以便运行模型，并将输出传达给用户计算机处理器 6。通过这种方式，必要的计算能力可以从用户计算机处理器 6 转移到服务器计算系统 12。
(b) The Input computer software module 8, in at least one embodiment, is programmed by computer software to:
(b) 在至少一个实施例中，输入计算机软件模块 8 由计算机软件编程，以：
(i) Accept desired procedure and Input Data including patient data, including 3D facial scans, photographs, videos, medical imaging (e.g., CT scans, MRI, X-rays, etc.), demographics (age, sex, race, etc.), medical history, and other relevant factors such as height, weight, body fat percentage, and patient desired results. Desired results may be input as specific amounts of tissue removal at particular points, length measurements between points or degree of repositioning, volume or mass to be added or subtracted from specific locations, or description of desired end results.
(i) 接受所需的程序和输入数据，包括病人数据，包括 3D 面部扫描、照片、视频、医学影像（如 CT 扫描、核磁共振成像、X 光等）、人口统计学（年龄、性别、种族等）、病史和其他相关因素，如身高、体重、体脂百分比和病人期望的结果。预期结果可以输入特定点的具体组织切除量、点之间的长度测量值或重新定位的程度、特定位置需要增加或减少的体积或质量，或对预期最终结果的描述。
(ii)Have an ability to integrate real-time data input, such as video scans during consultations.
(ii) 具备整合实时数据输入的能力，如会诊期间的视频扫描。
(c) The Visualization computer software module 4, in at least one embodiment is programmed by computer software to:
(c) 可视化计算机软件模块 4 在至少一个实施例中由计算机软件编程，以便：
(ii)Provide detailed, real-time 3D visualizations of the patient’s face, the patient’s face with overlaid surgical markings and / or injection or procedure plans generated by the AI Engine module 10, and the post-operative patient’s face as predicted by the Ai Engine module 10.
(ii) 提供详细、实时的病人面部三维可视化图像、人工智能引擎模块 10 生成的叠加手术标记和/或注射或手术计划的病人面部图像，以及人工智能引擎模块 10 预测的术后病人面部图像。
(ii) Optionally overlay additional information such as critical anatomical features, such as bone structure, blood vessels and nerves, to guide safe execution and achieve the desired results.
(ii) 可选择叠加其他信息，如关键的解剖特征，如骨骼结构、血管和神经，以指导安全实施并达到预期效果。
(iii) Allow for real-time visualization of changes to any inputs or modifications to the suggested surgical markings and / or injection or procedure plans, and user desired results.
(iii) 允许实时可视化对任何输入的更改或对建议手术标记和/或注射或手术计划的修改，以及用户期望的结果。
Example use case in blepharoplasty:
眼睑整形术中的用例：
A user may input Input Data including their specific patient data and demographics for an upper blepharoplasty procedure, through Input module 8, indicating a desire to remove a generalized amount of excess skin from their upper eyelids. Hidden features such as the eyelid skin crease is an essential part of blepharoplasty, and manipulation of the eyelids may be necessary to provide better views during imaging or capturing video in order to provide the AI system with enough information to provide a complete analysis.
用户可通过输入模块 8 输入输入数据，包括上眼睑整形手术的具体患者数据和人口统计数据，表明希望去除上眼睑的一般多余皮肤。眼睑皮肤褶皱等隐藏特征是眼睑整形术的重要组成部分，在成像或捕捉视频时可能需要操作眼睑以提供更好的视角，从而为人工智能系统提供足够的信息以进行完整的分析。
The system such as through AI Engine module 10 is programmed by computer software and/or configured analyze the images and video of the patient’s face, noting various examination measurements and criteria for different parts of the eye and surrounding region. For example, ptosis, symmetry or lack thereof between eyelids and brows, amount and thickness of excess skin, inflammation, skin lesions, and various other conditions are identified and considered. Demographic specific features such as epiblepharon in Asians may also be identified. Default values may be initially used to generate surgical markings and postoperative facial image. For example, the ratio between the tarsal platform to the distance between the upper lid crease and brow should be 1:1.618, or the Golden ratio, and the corneal reflex-lid margin distance in Caucasians should measure between 3.5 to 4mm (millimeters) and be symmetrical. These default measurements may be overridden by an advanced user such as a surgeon during data input.
该系统（例如通过人工智能引擎模块 10）通过计算机软件编程和/或配置分析患者面部的图像和视频，记录眼部不同部位和周围区域的各种检查测量值和标准。例如，眼睑下垂、眼睑和眉毛之间是否对称、多余皮肤的数量和厚度、炎症、皮肤病变以及其他各种情况都会被识别和考虑。还可识别特定的人口特征，如亚洲人的外眦赘皮。默认值最初可用于生成手术标记和术后面部图像。例如，跗骨平台与上睑皱襞和眉毛之间距离的比例应为 1:1.618，即黄金比例，白种人的角膜反射-睑缘距离应在 3.5 至 4 毫米（毫米）之间，且应对称。高级用户（如外科医生）可在输入数据时覆盖这些默认测量值。
Interactive models of the patient’s face, the patient’s face with surgical markings overlaid, and the post-operative patient’s face as predicted by the surgical markings is generated by AI Engine module 10 in accordance with computer programming. In at least one embodiment, the Input module 8 is programmed to permit a user to change the numerical values associated with the procedure plan or each individual surgical marking, and the AI Engine module 10 is programmed and/or configured to regenerate the surgical markings and expected results in real-time, and to display them through the Visualization module 4. Alternatively, the user may interactively manipulate, through the Input module 8 and/or the Visualization module 4, the surgical markings and the numerical values and expected results are regenerated in real-time.
人工智能引擎模块 10 根据计算机编程生成患者面部、叠加手术标记的患者面部以及手术标记预测的术后患者面部的交互式模型。在至少一个实施例中，输入模块 8 被编程为允许用户更改与手术计划或每个单独手术标记相关的数值，而人工智能引擎模块 10 被编程和/或配置为实时重新生成手术标记和预期结果，并通过可视化模块 4 显示出来。或者，用户可以通过输入模块 8 和/或可视化模块 4 对手术标记进行交互式操作，并实时重新生成数值和预期结果。
Alternatively, the AI Engine module 10 may generate one or various visualization of the patient’s post-operative patient’s face based on various factors such as results of previous procedures of similar demographics, risk factors, etc. For example, the AI Engine model 10 may recognize that the patient is Asian and has epiblepharon and generate a version of the visualization that corrects this, without the patient specifically mentioning the condition or inputting correcting for it in the input desired results. The procedure plan(s) may be generated before or after the visualization(s) are generated.
或者，人工智能引擎模块 10 可以根据各种因素，如类似人口统计学的先前手术结果、风险因素等，生成患者术后面部的一种或多种可视化效果。例如，人工智能引擎模型 10 可以识别出患者是亚洲人且患有外翻，并生成一个可视化版本来纠正这一点，而无需患者特别提及该情况或在输入的预期结果中输入纠正该情况的内容。手术计划可在可视化生成之前或之后生成。
Once the user is satisfied with the surgical markings and results, the plan is finalized, and an indication that the plan is finalized is configured to be stored in computer memory, such as computer memory 2. The procedure plans may be sent to a marking device 22 which may be used to mark or draw the procedure plans on the patient’s face based on the procedure plans generated by the AI Engine. The marking device 22 may be a robotic arm or similar device that may automatically apply the procedure plans such as by directing a Sharpie without user or surgeon intervention. Alternatively, the marking device 22 may apply the markings by means of projecting light or laser(s) directly onto the patient’s face.
一旦用户对手术标记和结果感到满意，计划就会最终确定，计划确定的指示被配置为存储在计算机存储器中，例如计算机存储器2。手术计划可发送到标记设备 22，该设备可用于根据人工智能引擎生成的手术计划在患者面部标记或绘制手术计划。标记设备 22 可以是机械臂或类似设备，它可以自动应用手术计划，例如在没有用户或外科医生干预的情况下使用锐利笔。另外，标记设备 22 也可以通过将光线或激光直接投射到患者面部的方式进行标记。
After the procedure, additional information may be uploaded such as images and video of the patient at designated time periods post-operation. In at least one embodiment, the system and/or Input module 8 is programmed to allow the user to grade the results of the AI generated results from the AI Engine module 10, in comparison to actual results and provide feedback on patient and procedure specific factors that occurred during surgery and recovery. This information may be added to the AI Engine module 10 and/or to computer memory 2, for further refinement in future use.
手术结束后，还可上传其他信息，如患者在手术后指定时间段的图像和视频。在至少一个实施例中，系统和/或输入模块 8 被编程为允许用户将人工智能引擎模块 10 生成的人工智能结果与实际结果进行比较打分，并就手术和恢复期间发生的患者和手术特定因素提供反馈。这些信息可以添加到人工智能引擎模块 10 和/或计算机内存 2 中，以便在未来使用中进一步完善。
In at least one embodiment, the AI Engine module 10 is programmed by computer software to continually scan the patient's face via video to refine the input data dynamically in response to additional information collected from the patient such as changes in posture, expression or physical manipulation such as lifting eyelids, while the user is interacting with the system. This feature allows for real-time updates to the suggested surgical markings or injection plan and the visualization of expected outcomes, enhancing accuracy and adaptability. In addition, the AI generated model by the AI Engine module 10 is programmed by computer software to mirror the patient’s face in real time, changing the displayed posture, expression or facial positioning based on the patient’s movement. Real-time adaptability ensures the system remains responsive to surgeon or patient-driven modifications, creating a seamless, interactive planning experience.
在至少一个实施例中，人工智能引擎模块 10 由计算机软件编程，可在用户与系统交互时，通过视频持续扫描患者的面部，以动态完善输入数据，从而响应从患者那里收集到的额外信息，如姿势、表情或物理操作（如抬起眼皮）的变化。这一功能允许实时更新建议的手术标记或注射计划以及预期结果的可视化，从而提高了准确性和适应性。此外，人工智能引擎模块 10 生成的人工智能模型由计算机软件编程，可实时镜像病人的面部，根据病人的动作改变显示的姿势、表情或面部定位。实时适应性可确保系统随时响应外科医生或患者驱动的修改，创造无缝、交互式的规划体验。
In at least one embodiment, the procedures are not limited to facial cosmetic surgery. The procedures may assist in a variety of surgical procedures such as orthopedics or general surgery. For any such procedure, references to specific anatomical regions such as face or facial may be replaced by the equivalent relevant anatomical region such as knee for knee replacement surgery, breast for cosmetic breast surgery, or head for neurosurgery, for example.
在至少一个实施方案中，这些程序并不局限于面部整容手术。这些程序可以协助各种外科手术，如整形外科或普通外科。对于任何此类手术，提及面部或脸部等特定解剖区域时，可以用相应的相关解剖区域代替，例如膝关节置换手术中的膝关节、乳房美容手术中的乳房或神经外科手术中的头部。
Although the invention has been described by reference to particular illustrative embodiments thereof, many changes and modifications of the invention may become apparent to those skilled in the art without departing from the spirit and scope of the invention. It is therefore intended to include within this patent all such changes and modifications as may reasonably and properly be included within the scope of the present invention’s contribution to the art.
尽管本发明已参照其特定的说明性实施例进行了描述，但对于本领域的技术人员来说，本发明的许多变化和修改可能是显而易见的，而不会偏离本发明的精神和范围。因此，本专利的目的是将本发明对本领域的贡献范围内可能合理和适当地包括的所有此类更改和修改包括在内。