Aesthetic-Aware Trajectory Planning for Multi-ROI UAV Aerial Cinematography
Highlights
- We propose an aesthetic-aware UAV trajectory planning framework for multi-ROI aerial cinematography that integrates viewpoint selection, trajectory generation, and global route optimization.
- The proposed method effectively balances flight feasibility, planning efficiency, and visual composition quality through a hierarchical planning strategy.
- The framework enables more autonomous and efficient UAV cinematography workflows, reducing dependence on manual operation and professional piloting skills.
- The integration of learning-based aesthetic evaluation provides a practical approach for improving visual quality in real-world UAV applications.
Abstract
1. Introduction
- We introduce a unified aesthetics-aware UAV aerial cinematography planning framework that hierarchically coordinates flight trajectory generation, camera pose control, inter-ROI transition planning, and global route organization, enabling simultaneous optimization of motion feasibility and visual appeal under multiple geometric and visual constraints.
- We develop a learning-based aesthetic evaluation mechanism for aerial viewpoints that quantitatively measures composition quality, providing a computable basis for incorporating visual aesthetics into UAV trajectory planning and decision-making.
- We propose a hierarchical and coordinated planning strategy from local to global levels, which unifies within-ROI filming optimization, inter-ROI transition planning, and global multi-ROI route organization within a coordinated cinematography pipeline to achieve a balanced trade-off among flight safety, path efficiency, and visual continuity in complex environments.
2. Related Work
2.1. Aesthetics-Based Camera Control
2.2. UAV Aerial Cinematography Trajectory Planning
2.3. Literature Gap and Research Positioning
3. Proposed Method
3.1. Problem Formulation and Framework Overview
3.2. Single-ROI Aesthetic-Aware Trajectory Planning
3.2.1. Initial Spatial Sampling Trajectory for a Single ROI
- Flight Radius DeterminationAccording to the rule-of-thirds composition principle, the main subject should occupy at least one-third of the image dimension. Based on the horizontal and vertical camera fields of view, the maximum observation distances can be computed.Let W and H denote the width and height of the ROI, and let and represent the horizontal and vertical camera field-of-view angles. The maximum horizontal and vertical observation distances areThe orbital flight radius is then determined aswhere denotes the radius of the cylindrical ROI.
- Altitude BoundsTo ensure that the bottom of the ROI remains visible in the captured image while considering the practical constraint of camera pitch, the minimum flight altitude is derived aswhere denotes the height of the ROI bottom.Similarly, when the UAV is located above the ROI center and the camera is oriented downward, the maximum flight altitude satisfying the composition constraint iswhere denotes the height of the ROI top.
- Spiral Sampling Trajectory GenerationBased on the derived orbital radius and altitude bounds, a multi-layer spiral ascent trajectory is constructed to generate candidate sampling viewpoints around the ROI. The trajectory center coincides with the cylindrical axis of the ROI, and the altitude increases gradually from to .Let denote the angular increment between consecutive sampling points. The coordinates of the i-th sampling point are defined aswhere denotes an additional safety margin, is the azimuth angle of the sampling point, is the initial angle, and is the corresponding altitude.During flight, the camera continuously faces the ROI center to ensure that the target remains within the central region of the image frame. The resulting spiral trajectory provides a structured set of candidate viewpoints for subsequent viewpoint evaluation and trajectory optimization, as illustrated in Figure 3.
3.2.2. Composition View Generation and Optimal Viewpoint Selection
- Ideal Composition PointsAccording to the rule-of-thirds composition principle, five commonly used framing anchors are considered: the image center and the four rule-of-thirds intersection points. These anchors form the candidate composition setAs illustrated in Figure 4, these anchors serve as candidate targets for camera orientation optimization.
- Framing CostThe framing cost measures the deviation between the projected ROI center and the ideal composition anchors. Let denote the projection of the ROI center in the image plane. Its normalized camera coordinate iswhere K is the camera intrinsic matrix. Similarly, the normalized coordinate of an ideal anchor isThe framing cost is defined as
- Visibility CostTo prevent the ROI from being truncated by image boundaries, a visibility constraint is introduced. Let , , , and denote the distances from the ROI bounding box to the image borders. A zoom factor is defined asThe visibility cost is then defined aswhere is a weighting parameter controlling the penalty strength of visibility violation. Since both the framing cost and the visibility penalty are defined on normalized image-plane coordinates, their magnitudes are generally within the order of . Accordingly, is empirically selected within the same order of magnitude to maintain a balanced contribution between composition alignment and visibility preservation.
- Optimal Composition View SelectionThe overall cost is defined asFor each sampling point, the composite cost is evaluated for all candidate composition anchors, and the orientation yielding the minimum cost is selected as the optimal composition view.The camera orientation required to align the ROI with the selected composition anchor can then be analytically derived from the geometric relationship between the current ROI projection and the target image-plane position. Each sampling position together with its optimal camera orientation forms a candidate viewpoint, which is subsequently used for viewpoint evaluation and trajectory generation.
3.2.3. CNN-Based Aesthetic Viewpoint Evaluation
- Teacher Aesthetic ModelThe teacher model is built upon the ReLIC++ aesthetic evaluation framework proposed by Zhao et al. [36], with MobileNetV2 adopted as the backbone network for visual feature extraction [37,38].The architecture adopts a dual-branch design to jointly capture global and local aesthetic cues:
- 1.
- Global perception branch: extracts holistic visual representations through global average pooling, capturing global composition layout, lighting distribution, and color harmony.
- 2.
- Self-attention branch: models spatial relationships between image regions using attention mechanisms, enhancing the representation of local composition structures.
By combining global and local representations, the teacher model can effectively learn comprehensive aesthetic features of images. - Lightweight Student ModelTo enable efficient inference in real-time 3D environments such as Unreal Engine, a lightweight aesthetic evaluation network termed LightNIMA is designed. The model inherits the score distribution prediction mechanism of the Neural Image Assessment (NIMA) framework proposed by [39], which represents image aesthetics using a probability distribution over multiple rating levels. To adapt this concept to real-time UAV trajectory planning, the network is further simplified through backbone truncation and knowledge distillation.Given an input image I, the student network first extracts visual features using a truncated MobileNetV2 backbone, where only the first nine layers are retained to reduce computational overhead. Based on these features, the LightNIMA architecture contains three lightweight modules:
- 1.
- Lightweight feature extraction: depthwise separable convolution blocks are employed to further process feature maps, significantly reducing the number of parameters while maintaining feature representation capability.
- 2.
- Statistical feature aggregation: global statistics, including maximum, minimum, mean, and standard deviation values of feature maps, are computed to obtain compact global descriptors.
- 3.
- Lightweight regression head: a shallow fully connected network predicts the aesthetic score distribution of the input image.
The network outputs a 10-dimensional aesthetic score distributionwhere denotes the probability that the image receives a score of i. This probabilistic representation follows the NIMA paradigm and provides a more expressive description of aesthetic perception compared with single-score prediction. - Knowledge Distillation TrainingTo preserve the perceptual capability of the teacher model while maintaining efficiency, a multi-objective knowledge distillation strategy is employed. During training, each input image is simultaneously fed into both the teacher and student networks. The student model is optimized to match the teacher outputs through several distillation objectives.The overall training loss is defined aswhere controls the balance between score distribution alignment and attention consistency, aligns the predicted score distributions, enforces consistency between attention maps, and matches intermediate feature representations.The three distillation objectives provide complementary knowledge transfer constraints at different representation levels. Specifically, aligns the global aesthetic score distributions between the teacher and student models through soft-label distillation, enabling the student network to preserve high-level aesthetic judgment capability. enforces consistency between spatial attention maps, which helps the student model focus on visually important regions related to composition and saliency. Meanwhile, constrains intermediate feature representations and improves semantic feature consistency during knowledge transfer. By jointly optimizing these objectives, the student model is able to retain essential perceptual and compositional capabilities of the teacher network while maintaining lightweight computational complexity suitable for real-time viewpoint evaluation.
- Datasets and Training StrategyThe model is trained on a mixture of the AVA dataset [40] and the BAID dataset [41]. AVA contains 255,530 photographs with aesthetic scores from 1 to 10, capturing photographic composition and lighting characteristics. BAID contains 60,337 artworks from the Boldbrush community, covering diverse artistic styles.A 1:1 mixture of AVA and BAID samples is used for training to enhance cross-domain aesthetic perception capability.It should be noted that although the AVA and BAID datasets are not specifically designed for UAV aerial cinematography, they contain large numbers of photographic and artistic samples that capture general aesthetic principles such as composition balance, rule of thirds, visual saliency, leading lines, and color harmony.Since the proposed framework mainly focuses on viewpoint-level composition quality evaluation rather than high-level cinematic editing semantics or temporal rhythm modeling, these general visual aesthetic characteristics still provide a meaningful basis for UAV viewpoint assessment.Rather than modeling high-level cinematic semantics or professional film editing styles, the proposed aesthetic evaluation model mainly focuses on viewpoint-level visual composition quality assessment, including composition balance, target placement, spatial saliency, and visual harmony. Therefore, general-purpose photographic and artistic datasets can still provide useful supervision for learning transferable low-level and mid-level aesthetic representations applicable to UAV viewpoint evaluation.Nevertheless, domain discrepancies between ground-level photography and aerial cinematography still exist due to differences in viewing perspectives, scene scales, and motion characteristics. The current framework does not explicitly perform aerial-specific domain adaptation or fine-tuning because of the limited availability of large-scale UAV cinematography aesthetic datasets with reliable subjective annotations. As a result, certain domain biases may still exist in complex aerial filming scenarios.Future work will investigate aerial-specific aesthetic datasets, transfer learning strategies, and cross-domain adaptation techniques to further improve the robustness and generalization capability of the aesthetic evaluation model in UAV cinematography applications.
- Viewpoint Aesthetic ScoringFor each candidate viewpoint generated along the sampling trajectory, the rendered image is fed into the trained LightNIMA network to obtain the aesthetic score distribution. The expected aesthetic score can be further computed as a scalar metric to evaluate viewpoint quality. This score is subsequently used to rank candidate viewpoints and guide the trajectory optimization process.
3.2.4. Optimal Viewpoint Set Selection and Local Trajectory Reconstruction
- Candidate Triplet GenerationTo ensure that the ROI can be observed from diverse directions, candidate viewpoints must satisfy spatial coverage constraints. For a cylindrical ROI with radius , if a viewpoint is located at distance from the ROI center, its horizontal coverage angle is defined asBy merging the coverage intervals of all viewpoints, the overall azimuth coverage of the ROI can be estimated. Only viewpoint combinations that provide sufficient coverage are retained as valid candidates.In addition, viewpoint distance constraints are imposed to avoid redundant observations and excessively long trajectories. Based on the CNN-based aesthetic evaluation model described in the previous subsection, viewpoints with aesthetic score lower than a threshold are discarded.All valid viewpoint triplets are collected aswhere M denotes the number of candidate triplets.
- Triplet EvaluationTo jointly evaluate spatial coverage and aesthetic quality, a composite scoring function is defined for each viewpoint triplet:where measures the coverage completeness of the ROI, is the aesthetic score predicted by the CNN model, and are weighting coefficients.Triplets are ranked according to this score, and the top candidates are retained for trajectory reconstruction.
- Local Trajectory ReconstructionFor each candidate viewpoint triplet , a local flight trajectory is generated using a quintic B-spline representation to ensure smooth and dynamically feasible motion.The trajectory is represented aswhere denotes the p-th order B-spline basis function and denotes the control points. The selected viewpoints serve as the primary control points, while additional control points are generated through interpolation and extrapolation to ensure trajectory continuity.
- Trajectory OptimizationAll reconstructed trajectories are first checked for feasibility through collision detection. Only collision-free trajectories are retained for further optimization.In the current framework, obstacle information is assumed to be available in advance from the reconstructed 3D environment used in the simulation platform. The considered obstacles mainly include static scene structures such as buildings, terrain surfaces, trees, and other large environmental objects. During trajectory validation, sampled trajectory points and interpolated trajectory segments are checked against the collision geometry of the scene to ensure that the generated trajectories remain collision-free and dynamically feasible.The current work mainly focuses on offline or semi-offline UAV cinematography planning in relatively static environments. Therefore, dynamic obstacles such as pedestrians or moving vehicles are not explicitly modeled in the present framework. Handling dynamic obstacle avoidance and online trajectory replanning will be investigated in future work.A multi-objective cost function is then defined to jointly evaluate trajectory length, viewpoint quality, and motion smoothness:where measures the overall trajectory length to encourage efficient flight paths, evaluates the average aesthetic quality of sampled viewpoints along the reconstructed trajectory based on the CNN-predicted aesthetic scores, and penalizes excessive trajectory curvature variation to encourage smooth and dynamically feasible UAV motion.In the current framework, trajectory smoothness mainly corresponds to the geometric continuity and curvature consistency of the reconstructed B-spline trajectory, thereby reducing abrupt turning behaviors and improving motion stability during aerial cinematography.The trajectory with the minimum total cost is selected as the optimal local trajectory for the ROI, ensuring safe, efficient, and aesthetically optimized aerial cinematography.
3.3. Inter-ROI Transition Trajectory Planning
3.3.1. Goal-Biased BiRRT* Transition Trajectory Generation
- Heuristic Sampling StrategyUniform random sampling used in conventional RRT planners is inefficient in cluttered environments. To address this limitation, a heuristic non-uniform sampling strategy is introduced:where biases sampling toward the region between the two trees, focuses sampling on narrow passages, and denotes global uniform sampling. This strategy improves exploration efficiency while maintaining global coverage.
- Dynamic Goal BiasingInstead of using a fixed goal bias probability, the goal sampling probability is dynamically adjusted according to the planning progress:where i is the current iteration index, is the maximum iteration number, and denotes the sampling success rate. This adaptive strategy balances exploration and exploitation during different search stages.
- Adaptive Connection ThresholdIn bidirectional RRT planners, the connection threshold determines when the two trees attempt to connect. To adapt to different environment complexities, an adaptive connection threshold is introduced:This mechanism dynamically adjusts the connection condition based on search progress and environmental feedback, improving the success rate of tree connections and the smoothness of the generated trajectories.
3.3.2. Multi-Criteria Evaluation and Optimal Path Selection
- Trajectory Smoothing and Feasibility ProcessingFor each candidate transition path, the discrete waypoints are first extracted as initial control points. A B-spline curve is then employed to reconstruct a smooth trajectory with improved continuity and executability:where denotes the B-spline basis function and denotes the control points.After smoothing, the reconstructed trajectory is further checked for feasibility, including collision avoidance and motion continuity. If collisions are detected, the control points are adjusted and the smooth trajectory is regenerated. If excessive turning motions are observed, local refinement is applied to improve continuity and smoothness.
- Transition Cost EvaluationFor a candidate transition trajectory connecting and , a multi-criteria cost is defined based on the following factors:
- 1.
- Path length cost, which constrains flight time and energy consumption;
- 2.
- Viewpoint quality cost, which evaluates the aesthetic quality of sampled viewpoints along the transition using the CNN-based model;
- 3.
- Camera orientation change cost, which penalizes abrupt changes in camera direction;
- 4.
- Turning smoothness cost, which measures directional continuity when entering and leaving ROIs;
- 5.
- Altitude change cost, which discourages abrupt vertical transitions.
The overall transition cost is defined aswhere are weighting coefficients.The weighting coefficients are selected to balance multiple competing objectives during transition trajectory generation. In the current framework, relatively larger weights are assigned to viewpoint quality and turning smoothness terms to encourage visually coherent and cinematographically smooth UAV motion, while path length and altitude variation terms mainly serve as auxiliary constraints for flight efficiency and trajectory stability.Specifically, increasing the viewpoint quality weight tends to favor trajectories containing more aesthetically favorable viewpoints, whereas increasing the turning smoothness weight suppresses abrupt directional changes and improves motion continuity between ROIs. Meanwhile, larger path length or altitude variation weights encourage shorter and more energy-efficient transitions but may reduce trajectory flexibility in cluttered environments. The final weighting configuration was determined empirically through iterative qualitative evaluation across multiple representative UAV cinematography scenarios. - Optimal Path SelectionThe total cost is computed for all candidate transition trajectories, and the trajectory with the minimum cost is selected as the optimal path between and . This multi-criteria evaluation strategy provides a balanced trade-off among flight efficiency, visual quality, and motion smoothness, and supplies reliable edge costs for the subsequent global visiting order optimization.
3.4. Global Multi-ROI Visiting Order Optimization
- Visit all ROIs and complete the corresponding cinematography tasks;
- Ensure smooth transitions between consecutive local ROI trajectories;
- Minimize the overall flight cost while satisfying feasibility constraints.
3.4.1. STSP Formulation for Multi-ROI Cinematography
3.4.2. Genetic Algorithm-Based Solution for Global Path Optimization
- Population InitializationThe initial population is generated by randomly permuting the ROI visiting order and randomly assigning entry and exit nodes, ensuring sufficient diversity in the search space.
- Fitness EvaluationThe fitness of a candidate route is defined as the reciprocal of its global path cost:Routes with lower cost therefore obtain higher fitness values.
- Evolutionary OperationsSelection, crossover, and mutation operations are applied to generate new candidate routes and explore the solution space while avoiding premature convergence.
- Global Route ConstructionAfter convergence, the best chromosome represents the optimal ROI visiting order and the corresponding entry/exit node configuration. The final global trajectory is constructed by concatenating local ROI trajectories with the optimal inter-ROI transition trajectories.
4. Experiments and Analysis
4.1. Experimental Setup
4.2. Single-ROI Cinematography Evaluation
4.2.1. Viewpoint Aesthetic Response Analysis
4.2.2. Student Model Performance Evaluation
4.2.3. Comparison of Local Trajectory Generation Methods
4.3. Goal-Biased BiRRT* Transition Trajectory Evaluation
4.3.1. Planner Performance Comparison
4.3.2. Obstacle Avoidance and Safety Evaluation
4.4. Global Multi-ROI Trajectory Evaluation
4.5. Computational Efficiency Analysis
- Local trajectory generation for individual ROIs;
- Inter-ROI transition path search and cost evaluation;
- STSP-based global visit order optimization.
5. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
Abbreviations
| A.-M. Coord. | Aesthetics-Motion Coordination |
| AVA | Aesthetic Visual Analysis Dataset |
| BAID | Behance Artistic Image Dataset |
| BiRRT* | Bidirectional Rapidly exploring Random Tree Star |
| CNN | Convolutional Neural Network |
| GA | Genetic Algorithm |
| MAE | Mean Absolute Error |
| MPC | Model Predictive Control |
| NIMA | Neural Image Assessment |
| RMSE | Root Mean Squared Error |
| ROI | Region of Interest |
| RL | Reinforcement Learning |
| RRT | Rapidly exploring Random Tree |
| RRT* | Rapidly exploring Random Tree Star |
| RT | Real-time Feasibility |
| STSP | Set Traveling Salesman Problem |
| TSP | Traveling Salesman Problem |
| UAV | Unmanned Aerial Vehicle |
| UE5 | Unreal Engine 5 |
References
- Li, Q.; Yang, X.; Lu, R.; Fan, J.; Wang, S.; Qin, Z. VisionICE: Air–Ground Integrated Intelligent Cognition Visual Enhancement System Based on a UAV. Drones 2023, 7, 268. [Google Scholar] [CrossRef]
- Adams, C. Dual Control: Investigating the Role of Drone (UAV) Operators in TV and Online Journalism. Media Commun. 2020, 8, 93–100. [Google Scholar] [CrossRef]
- Alcántara, A.; Capitán, J.; Cunha, R.; Ollero, A. Optimal Trajectory Planning for Cinematography with Multiple Unmanned Aerial Vehicles. Robot. Auton. Syst. 2021, 140, 103778. [Google Scholar] [CrossRef]
- Wen, Y.; Liang, D.; Wu, Y. Study on the Key Technology and Application of UAV Surveying and Mapping Data Processing. J. Phys. Conf. Ser. 2021, 1744, 022089. [Google Scholar] [CrossRef]
- Lambertini, A.; Mandanici, E.; Tini, M.A.; Vittuari, L. Technical Challenges for Multi-Temporal and Multi-Sensor Image Processing Surveyed by UAV for Mapping and Monitoring in Precision Agriculture. Remote Sens. 2022, 14, 4954. [Google Scholar] [CrossRef]
- Jovanović, D.; Milovanov, S.; Ruskovski, I.; Govedarica, M.; Sladić, D.; Radulović, A.; Pajić, V. Building Virtual 3D City Model for Smart Cities Applications: A Case Study on Campus Area of the University of Novi Sad. ISPRS Int. J. Geo-Inf. 2020, 9, 476. [Google Scholar] [CrossRef]
- Alawad, W.; Halima, N.B.; Aziz, L. An Unmanned Aerial Vehicle (UAV) System for Disaster and Crisis Management in Smart Cities. Electronics 2023, 12, 1051. [Google Scholar] [CrossRef]
- Al-Dosari, K.; Fetais, N. A New Shift in Implementing Unmanned Aerial Vehicles (UAVs) in the Safety and Security of Smart Cities: A Systematic Literature Review. Safety 2023, 9, 64. [Google Scholar] [CrossRef]
- Abbas, N.; Abbas, Z.; Liu, X.; Khan, S.S.; Foster, E.D.; Larkin, S. A Survey: Future Smart Cities Based on Advance Control of Unmanned Aerial Vehicles (UAVs). Appl. Sci. 2023, 13, 9881. [Google Scholar] [CrossRef]
- Pueyo, P.; Montijano, E.; Murillo, A.C.; Schwager, M. CineMPC: Controlling Camera Intrinsics and Extrinsics for Autonomous Cinematography. In Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA, 23–27 May 2022; IEEE: New York, NY, USA, 2022; pp. 4058–4064. [Google Scholar] [CrossRef]
- Koch, W.; Mancuso, R.; West, R.; Bestavros, A. Reinforcement Learning for UAV Attitude Control. ACM Trans. Cyber-Phys. Syst. 2019, 3, 22. [Google Scholar] [CrossRef]
- Ait Saadi, A.; Soukane, A.; Meraihi, Y.; Benmessaoud Gabis, A.; Mirjalili, S.; Ramdane-Cherif, A. UAV Path Planning Using Optimization Approaches: A Survey. Arch. Comput. Methods Eng. 2022, 29, 4233–4284. [Google Scholar] [CrossRef]
- Ahmad Shazali, A.S.; Tahar, K.N. Virtual 3D Model of Canseleri Building via Close-Range Photogrammetry Implementation. Int. J. Build. Pathol. Adapt. 2019, 38, 217–227. [Google Scholar] [CrossRef]
- Zhou, H.; Ji, Z.; You, X.; Liu, Y.; Chen, L.; Zhao, K.; Lin, S.; Huang, X. Geometric Primitive-Guided UAV Path Planning for High-Quality Image-Based Reconstruction. Remote Sens. 2023, 15, 2632. [Google Scholar] [CrossRef]
- Hao, J.; Zhou, Y.; Zhang, G.; Lv, Q.; Wu, Q. A Review of Target Tracking Algorithm Based on UAV. In Proceedings of the 2018 IEEE International Conference on Cyborg and Bionic Systems (CBS), Shenzhen, China, 25–27 October 2018; IEEE: New York, NY, USA, 2018; pp. 328–333. [Google Scholar] [CrossRef]
- DJI. Introduction to Waypoint Flight Mode of DJI Fly. 2026. Available online: https://repair.dji.com/help/content?customId=01700007343&spaceId=17&re=US&lang=en (accessed on 20 January 2026).
- Blinn, J. Where Am I? What Am I Looking at? (Cinematography). IEEE Comput. Graph. Appl. 1988, 8, 76–81. [Google Scholar] [CrossRef]
- Drucker, S.M.; Zeltzer, D. Intelligent Camera Control in a Virtual Environment. In Proceedings of the Graphics Interface ’94—GI ’94, Banff, AB, Canada, 18–20 May 1994; Morgan Kaufmann Publishers Inc.: San Mateo, CA, USA, 1994; pp. 190–199. [Google Scholar]
- Gleicher, M.; Witkin, A. Through-the-Lens Camera Control. In Proceedings of the 19th Annual Conference on Computer Graphics and Interactive Techniques, Chicago, IL, USA, 26–31 July 1992; ACM: New York, NY, USA, 1992; pp. 331–340. [Google Scholar] [CrossRef]
- Datta, R.; Joshi, D.; Li, J.; Wang, J.Z. Studying Aesthetics in Photographic Images Using a Computational Approach. In Computer Vision–ECCV 2006; Hutchison, D., Kanade, T., Kittler, J., Kleinberg, J.M., Mattern, F., Mitchell, J.C., Naor, M., Nierstrasz, O., Pandu Rangan, C., Steffen, B., et al., Eds.; Springer: Berlin/Heidelberg, Germany, 2006; Volume 3953, pp. 288–301. [Google Scholar] [CrossRef]
- Mai, L.; Le, H.; Niu, Y.; Liu, F. Rule of Thirds Detection from Photograph. In Proceedings of the 2011 IEEE International Symposium on Multimedia, Dana Point, CA, USA, 5–7 December 2011; IEEE: New York, NY, USA, 2011; pp. 91–96. [Google Scholar] [CrossRef]
- Arijon, D. Grammar of the Film Language; Silman-James Press: Los Angeles, CA, USA; Samuel French Trade: Hollywood, CA, USA, 1991. [Google Scholar]
- Bowen, C.J. Grammar of the Shot; Focal Press: Burlington, MA, USA, 2013. [Google Scholar]
- He, L.w.; Cohen, M.F.; Salesin, D.H. The Virtual Cinematographer: A Paradigm for Automatic Real-Time Camera Control and Directing. In Seminal Graphics Papers: Pushing the Boundaries, 1st ed.; Whitton, M.C., Ed.; ACM: New York, NY, USA, 2023; Volume 2, pp. 707–714. [Google Scholar] [CrossRef]
- Gebhardt, C.; Stevšić, S.; Hilliges, O. Optimizing for Aesthetically Pleasing Quadrotor Camera Motion. ACM Trans. Graph. 2018, 37, 90. [Google Scholar] [CrossRef]
- Vázquez, P.P.; Feixas, M.; Sbert, M.; Heidrich, W. Viewpoint Selection Using Viewpoint Entropy. In Proceedings of the Vision Modeling and Visualization Conference 2001—VMV ’01, Stuttgart, Germany, 11–23 November 2001; Aka GmbH: Berlin, Germany, 2001; pp. 273–280. [Google Scholar]
- Xie, K.; Yang, H.; Huang, S.; Lischinski, D.; Christie, M.; Xu, K.; Gong, M.; Cohen-Or, D.; Huang, H. Creating and Chaining Camera Moves for Quadrotor Videography. ACM Trans. Graph. 2018, 37, 88. [Google Scholar] [CrossRef]
- Bonatti, R.; Wang, W.; Ho, C.; Ahuja, A.; Gschwindt, M.; Camci, E.; Kayacan, E.; Choudhury, S.; Scherer, S. Autonomous Aerial Cinematography in Unstructured Environments with Learned Artistic Decision-making. J. Field Robot. 2020, 37, 606–641. [Google Scholar] [CrossRef]
- Joubert, N.; Roberts, M.; Truong, A.; Berthouzoz, F.; Hanrahan, P. An Interactive Tool for Designing Quadrotor Camera Shots. ACM Trans. Graph. 2015, 34, 238. [Google Scholar] [CrossRef]
- Joubert, N.; E, J.L.; Goldman, D.B.; Berthouzoz, F.; Roberts, M.; Landay, J.A.; Hanrahan, P. Towards a Drone Cinematographer: Guiding Quadrotor Cameras Using Visual Composition Principles. arXiv 2016, arXiv:1610.01691. [Google Scholar] [CrossRef]
- Serin, E.; Hasan Adali, S.; Balcisoy, S. Automatic Path Generation for Terrain Navigation. Comput. Graph. 2012, 36, 1013–1024. [Google Scholar] [CrossRef]
- Sokolov, D.; Plemenos, D. Virtual World Explorations by Using Topological and Semantic Knowledge. Vis. Comput. 2008, 24, 173–185. [Google Scholar] [CrossRef]
- Lino, C.; Christie, M.; Lamarche, F.; Schofield, G.; Olivier, P. A Real-Time Cinematography System for Interactive 3D Environments. In Proceedings of the SCA’10: 2010 ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Madrid, Spain, 2–4 July 2010. [Google Scholar] [CrossRef]
- Epic Games. Unreal Engine 5.7 Documentation. 2026. Available online: https://dev.epicgames.com/documentation/en-us/unreal-engine/unreal-engine-5-7-documentation (accessed on 20 January 2026).
- Microsoft. AirSim Simulator. 2026. Available online: https://microsoft.github.io/AirSim/ (accessed on 20 January 2026).
- Zhao, L.; Shang, M.; Gao, F.; Li, R.; Huang, F.; Yu, J. Representation Learning of Image Composition for Aesthetic Prediction. Comput. Vis. Image Underst. 2020, 199, 103024. [Google Scholar] [CrossRef]
- Sandler, M.; Howard, A.; Zhu, M.; Zhmoginov, A.; Chen, L.C. MobileNetV2: Inverted Residuals and Linear Bottlenecks. arXiv 2018, arXiv:1801.04381. [Google Scholar] [CrossRef]
- Howard, A.G.; Zhu, M.; Chen, B.; Kalenichenko, D.; Wang, W.; Weyand, T.; Andreetto, M.; Adam, H. MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv 2017, arXiv:1704.04861. [Google Scholar] [CrossRef]
- Talebi, H.; Milanfar, P. NIMA: Neural Image Assessment. IEEE Trans. Image Process. 2018, 27, 3998–4011. [Google Scholar] [CrossRef] [PubMed]
- Murray, N.; Marchesotti, L.; Perronnin, F. AVA: A Large-Scale Database for Aesthetic Visual Analysis. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA, 16–21 June 2012; IEEE: New York, NY, USA, 2012; pp. 2408–2415. [Google Scholar] [CrossRef]
- Yi, R.; Tian, H.; Gu, Z.; Lai, Y.K.; Rosin, P.L. Towards Artistic Image Aesthetics Assessment: A Large-scale Dataset and a New Method. In Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 17–24 June 2023; IEEE: New York, NY, USA, 2023; pp. 22388–22397. [Google Scholar] [CrossRef]
- Kuffner, J.; LaValle, S. RRT-connect: An Efficient Approach to Single-Query Path Planning. In Proceedings of the 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065), San Francisco, CA, USA, 24–28 April 2000; IEEE: New York, NY, USA, 2000; Volume 2, pp. 995–1001. [Google Scholar] [CrossRef]









| Method | Feas. | A.-M. | M-ROI | V-Cont. | Unified | Autonomy | RT |
|---|---|---|---|---|---|---|---|
| Geometric camera control | × | × | × | Partial | × | Low | ✓ |
| Rule-based aesthetic framing | × | × | × | Partial | × | Medium | ✓ |
| Vision-based viewpoint evaluation | × | × | × | Partial | × | Medium | Partial |
| Navigation-oriented path planning | ✓ | × | Partial | × | × | Medium | ✓ |
| Optimization-based cinematography planning | ✓ | Partial | Partial | Partial | × | Medium | × |
| Commercial UAV systems | ✓ | × | Partial | Partial | × | Medium | ✓ |
| Proposed Framework | ✓ | ✓ | ✓ | ✓ | ✓ | High | Partial |
| Metric | Teacher Model | Student Model |
|---|---|---|
| Model Size (MB) | 17.38 | 1.18 |
| Average Inference Time (ms) | 10.11 | 3.19 |
| Pearson Correlation Coefficient | – | 0.9461 () |
| Spearman Correlation Coefficient | – | 0.9030 () |
| Mean Absolute Error (MAE) | – | 0.2786 |
| Root Mean Squared Error (RMSE) | – | 0.2952 |
| Metric | Goal-Biased BiRRT* | Standard BiRRT | Standard RRT |
|---|---|---|---|
| Average Time | 0.28 s | 0.40 s | 26.01 s |
| Time Std. Dev. | 0.08 s | 0.18 s | 30.07 s |
| Average Path Length | 123.99 m | 121.65 m | 126.30 m |
| Path Length Std. Dev. | 7.68 m | 4.95 m | 42.49 m |
| Success Rate | 100% | 100% | 90% |
| Average Node Count | 273.9 | 357.6 | 4133.4 |
| Node Count Std. Dev. | 58.49 | 106.88 | 3360.22 |
| Scenario | Computation Stage | Time (s) |
|---|---|---|
| Wuhan University | Local ROI Trajectory Generation | 379.69 |
| Inter-ROI Transition Search and Cost Evaluation | 370.71 | |
| STSP Optimization | 0.087 | |
| Central Park | Local ROI Trajectory Generation | 369.14 |
| Inter-ROI Transition Search and Cost Evaluation | 946.19 | |
| STSP Optimization | 0.086 | |
| Chibi | Local ROI Trajectory Generation | 265.46 |
| Inter-ROI Transition Search and Cost Evaluation | 662.66 | |
| STSP Optimization | 0.096 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
He, Z.; Liu, Y.; Ji, Z. Aesthetic-Aware Trajectory Planning for Multi-ROI UAV Aerial Cinematography. Drones 2026, 10, 380. https://doi.org/10.3390/drones10050380
He Z, Liu Y, Ji Z. Aesthetic-Aware Trajectory Planning for Multi-ROI UAV Aerial Cinematography. Drones. 2026; 10(5):380. https://doi.org/10.3390/drones10050380
Chicago/Turabian StyleHe, Zijun, Yuchen Liu, and Zheng Ji. 2026. "Aesthetic-Aware Trajectory Planning for Multi-ROI UAV Aerial Cinematography" Drones 10, no. 5: 380. https://doi.org/10.3390/drones10050380
APA StyleHe, Z., Liu, Y., & Ji, Z. (2026). Aesthetic-Aware Trajectory Planning for Multi-ROI UAV Aerial Cinematography. Drones, 10(5), 380. https://doi.org/10.3390/drones10050380

