OSSAPTestingPlus: A Blockchain-Based Collaborative Framework for Enhancing Trust and Integrity in Distributed Agile Testing of Archaeological Photogrammetry Open-Source Software
Abstract
1. Introduction
1.1. Background and Motivation
1.2. Comparative Novelty and Positioning of OSSAPTestingPlus
- In-lifecycle enforcement vs. post hoc audit OSSAPTestingPlus embeds acceptance criteria execution and payment release inside the testing lifecycle (private Ethereum smart contracts), rather than using a ledger only for logging/audit after CI concludes.
- Incentive-aligned testing We couple verifiable test pass events with automatic, on-chain compensation, addressing the long-standing issue of missed tests in distributed OSS (no-pass ⇒ no-pay).
- Domain-tailored provenance for OSSAP We model photogrammetry-specific artifacts (e.g., geometry/texture outputs, reconstruction KPIs) and their hashes, enabling traceability demanded in digital heritage workflows, with private-chain privacy and low-latency confirmations.
1.3. Research Questions and Hypotheses
1.4. Operationalization and Evaluation
2. Materials and Methods
2.1. The Proposed Framework OSSAPTestingPlus
2.1.1. Private Ethereum Blockchain Network
2.1.2. Interaction Between Components
2.1.3. Data Integrity and Security
2.1.4. Scalability and Performance Considerations
2.2. Test Case Creation and Repository


2.2.1. Test Case Execution and Recording
2.2.2. Result Verification and Validation
2.2.3. Feedback and Collaboration
2.2.4. Compensation and Incentive Calculation
2.2.5. Enhanced Transparency and Traceability
2.2.6. Improved Collaboration and Communication
2.2.7. Increased Trust and Security
2.2.8. Fair Compensation and Incentives
2.2.9. Evaluation Criteria
2.2.10. Research Findings
2.2.11. Future Enhancements
2.3. Experimental Design
2.4. Measurement Metrics
2.5. Data-Collection Procedure
2.6. Reproductibility and Data Availability
- Solidity contracts (CustomerAgreement.sol, DeveloperAgreement.sol, AcceptanceTest.sol),
- Hardhat configuration and deployment script (scripts/deploy.js),
- A minimal REST API wrapper (server/index.js) for experiment automation via Postman,
- A Postman collection (postman/OSSAPTestingPlus.postman_collection.json),
- Sample performance logs (data/sample_performance_logs.csv), and
- A step-by-step README to reproduce all experiments end-to-end.
2.7. Ethical Consideration
2.8. Methodological Alignment Summary
3. Results
3.1. Framework Architecture
3.1.1. Smart Contract Functionalities
3.1.2. Workflow and Control Flow
3.1.3. OSSAPTestingPlus Smart Contract Algorithm
| Algorithm 1. OSSAPTestingPlus Smart Contract Algorithm |
| 1. Begin 2. Deploy smart contract with defined roles Developer, QA, Client 3. If user_role == Developer then a. Call addFR(FR_id, description) b. Emit event FR_Added c. Optionally call changeFR(FR_id, updated_description) 4. If user_role == QA then a. Call addStatus(FR_id, status) b. Emit event FR_Status_Updated c. Optionally call changeStatus(FR_id, new_status) 5. If user_role == Client then a. Call verifyAcceptance(FR_id) b. If accepted then i. Call releasePayment(FR_id) ii. Emit event PaymentReleased 6. All events logged on blockchain ledger 7. Ensure access control for each function using require(msg.sender == role) 8. End |
3.1.4. Deployment and Execution Environment
3.1.5. Overview of Evaluation Process
3.2. Performance Evaluation
3.2.1. The Background of Performance Evaluation
3.2.2. Performance Metrics and Indicators
3.2.3. Experimental Setup and Data Collection
- Smart Contract for Acceptance Test
| // SPDX-License-Identifier MIT pragma solidity ^0.8.0; /// @title Acceptance Test Contract /// @notice Handles payment and test flow between a customer and a developer contract AcceptanceTest { address public customerAddress; address public developerAddress; uint256 public testingFee; bool public isTestCompleted; /// @notice Constructor to initialize test contract /// @param _customerAddress Address of the customer /// @param _developerAddress Address of the developer /// @param _testingFee Fee for acceptance testing constructor(address _customerAddress, address _developerAddress, uint256 _testingFee) { customerAddress = _customerAddress; developerAddress = _developerAddress; testingFee = _testingFee; } /// @dev Restricts function to only be called by the customer modifier onlyCustomer() { require(msg.sender == customerAddress, "Only customer can initiate the acceptance test"); } /// @dev Restricts function to only be called by the developer modifier onlyDeveloper() { require(msg.sender == developerAddress, "Only developer can complete the acceptance test"); } /// @notice Initiates the acceptance test, must be called by the customer with exact payment function initiateTest() external payable onlyCustomer { require(msg.value == testingFee, "Testing fee must be paid in full"); isTestCompleted = false; // Logic for test initiation can be added here } /// @notice Marks the test as complete and transfers payment to developer function completeTest() external onlyDeveloper { require(!isTestCompleted, "Test already completed"); isTestCompleted = true; // Transfer payment to developer (bool success, ) = payable(developerAddress).call{value testingFee}(""); require(success, "Payment transfer to developer failed"); } } |
3.2.4. Performance Evaluation Results
- get_chain
- connect_node
- mine_block
- add_transaction
- is_chain_valid
- replace_chain
3.2.5. Comparison with Traditional Approaches
3.2.6. Interpretation of Results and Findings
3.2.7. Validity and Reliability of the Evaluation
3.2.8. Transaction Latency and Throughput
3.2.9. Gas Consumption and Resource Cost
3.2.10. Transparency and Audit Traceability
3.2.11. Trust, Fairness, and Payment Enforcement
3.3. Comparative Baseline Discussion
4. Discussion
4.1. Results and Analysis
- Increasing Number of Users
- Increasing File Size
4.2. Threats to Validity
4.2.1. Internal Validity
4.2.2. External Validity
4.2.3. Construct Validity
4.2.4. Conclusion Validity
4.3. Discussion on Results
Benefits of the Blockchain Integration
4.4. Scalability and Network Constraints
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
References
- Rahman, A.; Islam, M.J.; Montieri, A.; Nasir, M.K.; Reza, M.M.; Band, S.S.; Pescape, A.; Hasan, M.; Sookhak, M.; Mosavi, A. Smartblock-SDN An optimized blockchain-SDN framework for resource management in IoT. IEEE Access 2021, 9, 28361–28376. [Google Scholar] [CrossRef]
- Spallone, R.; Lamberti, F.; Olivieri, L.M.; Ronco, F.; Castagna, L. Ar and Vr for enhancing museums’ heritage through 3d reconstruction of fragmented statue and architectural context. Int. Arch. Photogramm. Remote Sens. Spatial Inf. Sci. 2022, 46, 473–480. [Google Scholar] [CrossRef]
- Heitman, C.C. Theorizing the Archive and Ethics of Open Access Archaeology. In Digital Heritage and Archaeology in Practice: Data, Ethics, and Professionalism; University Press of Florida: Gainesville, FL, USA, 2022; pp. 220–240. [Google Scholar]
- Sujeetha, R.; Preetha, C.A.S.D. A literature survey on smart contract testing and analysis for smart contract based blockchain application development. In Proceedings of the 2021 2nd International Conference on Smart Electronics and Communication (ICOSEC), Trichy, India, 7–9 October 2021; pp. 378–385. [Google Scholar]
- Farooq, M.S.; Ahmed, F. A Blockchain-Based Framework for Distributed Agile Software Testing Life Cycle. arXiv 2023, arXiv:2307.07212. [Google Scholar] [CrossRef]
- Orso, A.; Rothermel, G. Software testing: A research travelogue (2000–2014). In Proceedings of the Future of Software Engineering Proceedings, Hyderabad, India, 31 May–7 June 2014; pp. 117–132. [Google Scholar]
- Bukhari, F.; Ilyas, S.; Rehman, L.; Gill, H.B.; Kanwal, K.; Kajla, N.I. Blockchain and Big Data to Revolutionize Archaeological Photogrammetry (AP) A Safe and Effective Method. J. Comput. Biomed. Inform. 2023, 4, 249–268. [Google Scholar]
- Faruk, M.J.H.; Subramanian, S.; Shahriar, H.; Valero, M.; Li, X.; Tasnim, M. Software engineering process and methodology in blockchain-oriented software development A systematic study. In Proceedings of the 2022 IEEE/ACIS 20th International Conference on Software Engineering Research, Management and Applications (SERA), Las Vegas, NV, USA, 22–25 May 2022; pp. 120–127. [Google Scholar]
- Gamido, H.V.; Gamido, M.V. Comparative review of the features of automated software testing tools. Int. J. Electr. Comput. Eng. 2019, 9, 4473–4478. [Google Scholar] [CrossRef]
- Koul, R. Blockchain oriented software testing-challenges and approaches. In Proceedings of the 2018 3rd International Conference for Convergence in Technology (I2CT), Pune, India, 6–8 April 2018; pp. 1–6. [Google Scholar]
- Ghosh, P.K.; Chakraborty, A.; Hasan, M.; Rashid, K.; Siddique, A.H. Blockchain application in healthcare systems a review. Systems 2023, 11, 38. [Google Scholar] [CrossRef]
- Miraz, M.H.; Ali, M. Blockchain enabled smart contract based applications Deficiencies with the software development life cycle models. arXiv 2020, arXiv:2001.10589. [Google Scholar] [CrossRef]
- Zhang, A.; Zhong, R.Y.; Farooque, M.; Kang, K.; Venkatesh, V.G. Blockchain-based life cycle assessment An implementation framework and system architecture. Resour. Conserv. Recycl. 2020, 152, 104512. [Google Scholar] [CrossRef]
- Kulkarni, A. A Blockchain-Based Approach for Tracing Security Requirements for Large Scale and Complex Software Development. Master’s Thesis, Arizona State University, Tempe, AZ, USA, 2022. [Google Scholar]
- Khatoon, A. A blockchain-based smart contract system for healthcare management. Electronics 2020, 9, 94. [Google Scholar] [CrossRef]
- Ramachandran, M. Testing, Verification, Validation, Simulation, and Quality Techniques. In Blockchain Engineering: Secure, Sustainable Frameworks for Healthcare Applications; Springer Nature Singapore: Singapore, 2025; pp. 369–410. [Google Scholar]
- Assiri, M.; Humayun, M. A blockchain-enabled framework for improving the software audit process. Appl. Sci. 2023, 13, 3437. [Google Scholar] [CrossRef]
- Olivieri, L.; Spoto, F. Software verification challenges in the blockchain ecosystem. Int. J. Softw. Tools Technol. Transf. 2024, 26, 431–444. [Google Scholar] [CrossRef]
- Yau, S.S.; Patel, J.S. A blockchain-based testing approach for collaborative software development. In Proceedings of the 2020 IEEE International Conference on Blockchain (Blockchain), Rhodes, Greece, 2–6 November 2020; pp. 98–105. [Google Scholar]
- Haleem, A.; Javaid, M.; Singh, R.P.; Suman, R.; Rab, S. Blockchain technology applications in healthcare: An overview. Int. J. Intell. Netw. 2021, 2, 130–139. [Google Scholar] [CrossRef]
- Ravani, A.; Edupuganti, S.; Pugh, J.; Sushama, S. Applications of Blockchain Technology An Industry Focus; CRC Press: Boca Raton, FL, USA, 2024. [Google Scholar]
- Punia, A.; Sharma, R.; Singh, P.; Kaur, S. QuickMedBlock: A Framework for Enhanced Attribute-Based Access Control Using Blockchain for EHR in Cloud. Peer-to-Peer Netw. Appl. 2025, 18, 258. [Google Scholar] [CrossRef]
- Akbar, M.A.; AlSanad, A.A. Empirical Investigation of Key Enablers for Secure DevOps Practices. IEEE Access 2025, 13, 43698–43715. [Google Scholar] [CrossRef]
- Zaydi, M.; Ahmed, R.; Khan, T.; Al-Bahri, S. Agile Security and Compliance Integration: Enhancing Cyber Resilience Through Dynamic, Automated Processes. In Agile Security in the Digital Era; CRC Press: Boca Raton, FL, USA, 2025; pp. 68–91. [Google Scholar]
- Arun, C.R.; Pani, A.K.; Kumar, P. Blockchain-Enabled Smart Contracts and the Internet of Things: Advancing the Research Agenda Through a Narrative Review. Multimed. Tools Appl. 2025, 84, 5097–5147. [Google Scholar]
- John William, A.D.; Rajendran, S.; Pranam, P.; Berry, Y.; Sreedharan, A.; Gul, J.; Paul, A. Blockchain Technologies Smart Contracts for Consumer Electronics Data Sharing and Secure Payment. Electronics 2023, 12, 208. [Google Scholar] [CrossRef]
- Krishnaiah, P.N.S.; Narayan, D.L.; Sutradhar, K. A survey on secure metadata of agile software development process using blockchain technology. Secur. Priv. 2023, 7, e342. [Google Scholar] [CrossRef]
- Terzi, S.; Stamelos, I. Architectural solutions for improving transparency, data quality, and security in eHealth systems by designing and adding blockchain modules, while maintaining interoperability the eHDSI network case. Heal. Technol. 2024, 14, 451–462. [Google Scholar] [CrossRef]
- Latif, M.A.; Khan, S.; Rehman, A.; Ali, R. Blockchain-Based Model to Predict Agile Software Estimation Using Machine Learning Techniques. IET Softw. 2025, 9238663. [Google Scholar] [CrossRef]
- Kamal, M.; Darwish, S.M.; El-Zoghabi, A.A. Towards a Comprehensive Testing Approach for Blockchain-Based Applications. In Proceedings of the 8th International Conference on Software Engineering and Information Management (ICSIM 2025), Singapore, 10–12 January 2025; pp. 24–30. [Google Scholar] [CrossRef]
- Porru, S.; Pinna, A.; Marchesi, M.; Tonelli, R. Blockchain-oriented software engineering challenges and new directions. In Proceedings of the 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), Buenos Aires, Argentina, 20–28 May 2017; pp. 169–171. [Google Scholar]
- Elakaş, A.; Sözer, H.; Şafak, I.; Kalkan, K. A systematic mapping on software testing for blockchains. Clust. Comput. 2024, 27, 7111–7126. [Google Scholar] [CrossRef]
- Saleh, S.M.; Madhavji, N.; Steinbacher, J. Towards a Blockchain-Based CI/CD Framework to Enhance Security in Cloud Environments. In Proceedings of the 20th International Conference on Evaluation of Novel Approaches to Software Engineering (ENASE 2025), Porto, Portugal, 4–6 April 2025. [Google Scholar]
- Farha, A.B.; Al-Mamun, A.; Agrawal, G. Poster A Scalable and Fault-Tolerant Decentralized Middleware for CI/CD Workflow. In Proceedings of the 2025 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW), Milano, Italy, 3–7 June 2025; pp. 1296–1297. [Google Scholar]
- Kezadri Hamiaz, M.; Driss, M. Ethereum Smart Contracts Under Scrutiny A Survey of Security Verification Tools, Techniques, and Challenges. Computers 2025, 14, 226. [Google Scholar] [CrossRef]
- Hejazi, N.; Lashkari, A.H. A comprehensive survey of smart contracts vulnerability detection tools Techniques and methodologies. J. Netw. Comput. Appl. 2025, 237, 104142. [Google Scholar] [CrossRef]
- Azimi, S.; Golzari, A.; Ivaki, N.; Laranjeiro, N. A systematic review on smart contracts security design patterns. Empir. Softw. Eng. 2025, 30, 95. [Google Scholar] [CrossRef]
- Fekih, R.B.; Lahami, M.; Bradai, S.; Jmaiel, M. Formal verification of ERC-based smart contracts A systematic literature review. IEEE Access 2025, 13, 11396–11422. [Google Scholar] [CrossRef]
- Almeida, R.; Hu, X. Blockchain-native DevOps: Continuous Integration and Testing on Permissioned Ledgers. IEEE Trans. Softw. Eng. 2024, 50, 4123–4138. [Google Scholar]
- Arif, T.; Jo, B.; Park, J.H. A Comprehensive Survey of Privacy-Enhancing and Trust-Centric Cloud-Native Security Techniques Against Cyber Threats. Sensors 2025, 25, 2350. [Google Scholar] [CrossRef]
- Ofem, P.; Isong, B.; Lugayizi, F. On the concept of transparency A systematic literature review. IEEE Access 2022, 10, 89887–89914. [Google Scholar] [CrossRef]








| Research Questions (RQs) | |
|---|---|
| RQ1 | How does the integration of blockchain-based smart contracts influence trust, transparency, and traceability among distributed OSSAP testing teams compared with traditional agile testing approaches? |
| RQ2 | Can OSSAPTestingPlus improve the operational efficiency of distributed agile testing—in terms of reduced transaction latency, higher throughput, and lower coordination overhead—without compromising data integrity? |
| RQ3 | Does the implementation of automated, incentive-driven compensation mechanisms through smart contracts increase tester motivation and fairness perception in distributed OSSAP environments? |
| H1 (Transparency & Traceability) | Implementing OSSAPTestingPlus significantly improves transparency and traceability of testing activities compared to traditional OSSAP agile testing methods. | Metric Audit completeness, number of verifiable blockchain records, stakeholder satisfaction score. |
| H2 (Efficiency & Performance) | OSSAPTestingPlus reduces average transaction latency and improves throughput efficiency by at least 20% relative to non-blockchain agile workflows. | Metric Mean transaction response time (s), average throughput (transactions/min), gas consumption (ETH). |
| H3 (Trust & Fair Compensation) | Smart-contract-based automated acceptance testing increases stakeholder trust and ensures equitable payment enforcement between developers and testers. | Metric Payment dispute rate, trust index from post-test surveys, compensation accuracy (%). |
| Study | Focus | Contribution | Limitations |
|---|---|---|---|
| Rahman, A.; Islam, M.J et al. [1] | Smart Block-SDN framework for IoT resource management | Utilizing blockchain and SDN architecture | Neglects software testing in blockchain-based applications |
| Sujeetha and Perumal [4] | Testing and analysis of smart contracts | Highlighted smart contract efficiency and security | Incomplete testing framework for blockchain systems |
| Farooq, M.S [5] | Software testing from 2000–2014 | Shift towards automated testing methods | Lack of focus on blockchain integration |
| Bukhari, F [7] | Limitations of SDLC models | Identified SDLC model limitations | No comprehensive testing |
| Gamido, H.V [9] | Testing blockchain-centric software | Identifying difficulties and solutions | Lacks a specialized framework for testing |
| Koul, R. [10] | Potential applications of blockchain technology | Highlighted blockchain’s potential in healthcare | No specific testing framework for blockchain |
| Khatoon, A. A [15] | Blockchain-based testing strategy | Improved collaboration using blockchain | Limited investigation of testing in blockchain environments |
| Parameter | Specification |
|---|---|
| Hardware | Intel Core i7 @ 3.6 GHz, 16 GB RAM, 512 GB SSD |
| Operating System | Ubuntu 22.04 LTS |
| Blockchain Network | Private Ethereum (5 nodes using geth client) |
| Consensus Algorithm | Proof of Authority (PoA) for deterministic block times |
| Smart-Contract Language | Solidity v0.8+, compiled in Remix IDE |
| Security Libraries | OpenZeppelin v4.x (ReentrancyGuardv5.x, Ownable v5.x, SafeMath v1.x) |
| API Interaction Tools | Postman v10 for HTTP GET/POST simulations |
| Transaction Volume | 700 iterations across 6 core functions (addFR, changeFR, addStatus, changeStatus, verifyAcceptance, releasePayment) |
| Data Capture | Blockchain event logs, system console metrics, and Postman response statistics |
| Category | Metric | Description | Unit |
|---|---|---|---|
| Transparency (H1) | Blockchain record completeness | Ratio of recorded vs. expected test events | % |
| Stakeholder traceability score | Number of verifiable links between tester ↔ developer actions | count | |
| Efficiency (H2) | Transaction latency | Mean time from function call to confirmation | seconds |
| Throughput | Successful transactions per minute | tx/min | |
| Gas consumption | Average ETH used per execution | ETH | |
| Trust & Fairness (H3) | Payment dispute rate | Number of failed or contested transactions | % |
| Compensation accuracy | Match between agreed and released payments | % | |
| Trust index | Survey-based Likert average (1–5 scale) | score |
| Metric | Observation |
|---|---|
| Transaction Response Time | Stable up to 500 users; slight increase beyond |
| Ledger File Size Growth | Linear and manageable |
| Smart Contract Gas Consumption | Efficient and optimized for minimal usage |
| Role-Based Access Control | Strictly enforced across all function calls |
| Acceptance & Payment Mechanism | Fully automated and reliably triggered by smart contract logic |
| Data Integrity | Maintained throughout; no rollback or data loss observed |
| Metric | Traditional Agile OSSAP | OSSAPTestingPlus | Improvement (%) |
|---|---|---|---|
| Average Transaction Latency (s) | 1.63 ± 0.10 | 1.27 ± 0.08 | 22.1 |
| Throughput (tx/min) | 32 | 38 | 18.8 |
| Failed Transactions (%) | 3.7 | 0.9 | 75.7 |
| Network Utilization (avg) | 78% | 72% | 7.7 |
| Function | Mean Gas Used | Std. Dev. | Description |
|---|---|---|---|
| addFR | 54,000 | 1300 | Functional requirement creation |
| changeFR | 60,000 | 1250 | Update to requirement details |
| verifyAcceptance | 68,000 | 1900 | Tester acceptance validation |
| releasePayment | 72,000 | 1750 | Smart-contract payment execution |
| Criterion | Traditional | OSSAPTestingPlus | Δ (%) |
|---|---|---|---|
| Trust in test verification | 3.2 | 4.5 | +40.6 |
| Perceived fairness of payment | 3.1 | 4.7 | +51.6 |
| Ease of coordination | 3.4 | 4.6 | +35.3 |
| Dimension | Metric | Baseline | OSSAPTestingPlus | Relative Improvement (%) |
|---|---|---|---|---|
| Efficiency (H2) | Latency | 1.63 s | 1.27 s | 22.1 |
| Throughput | 32 tx/min | 38 tx/min | 18.8 | |
| Gas Usage | – | −14% | 14.0 | |
| Transparency (H1) | Audit Completeness | 98.7% | 100% | 1.3 |
| Traceability Index | 78% | 97% | 24.4 | |
| Trust & Fairness (H3) | Trust Score | 3.2 | 4.5 | 40.6 |
| Fairness Score | 3.1 | 4.7 | 51.6 | |
| Payment Disputes | 4.3% | 0% | 100% |
| Key Aspect | Result |
|---|---|
| Transaction Response Time | Stable under load up to 600 users; slight delay beyond |
| Ledger File Growth | Linear and manageable |
| Access Control | Successfully enforced role-specific permissions |
| Trust and Transparency | Improved significantly via blockchain immutability and open audit trail |
| Coordination & Collaboration | Enabled through decentralized and traceable smart contract workflows |
| Traditional STLC Challenges | OSSAPTestingPlus Blockchain Solutions |
|---|---|
| Lack of traceability | Immutable event logging via smart contracts |
| Poor accountability and role confusion | Role-based access and enforcement via contract logic |
| Disputes over test result authenticity | Transparent, verifiable test status and FR changes on-chain |
| Payment delays for testers | Automated payment release through smart contracts |
| Incomplete testing due to miscommunication | Auditable interactions and role-triggered updates |
| OSS Process | Blockchain Application |
|---|---|
| Developer commits | Stored on chain as timestamped transactions |
| Test results | Verified & logged immutably |
| Code review | Smart contract conditions enforce QA |
| Model datasets | Versioned using IPFS or chain linked metadata |
| Benefit | Description |
|---|---|
| Decentralized Trust | Contributors from anywhere can participate and be validated securely |
| Immutable Audit Trails | Every code and test action is logged and cannot be changed retrospectively |
| Enhanced Collaboration | Historical models and test cases can be reused and extended reliably |
| Data Provenance | Ensures that reconstructions trace back to original raw imagery |
| Better Accountability | Smart contracts automate approval flows and detect anomalies |
| Dimension/Metric (Unit) | Traditional Agile OSSAP (No Blockchain) | Blockchain-Based OSSAPTestingPlus |
|---|---|---|
| Process & QA outcomes | ||
| Acceptance-test completion latency (h) | 36 [24–52] | 18 [12–28] |
| Unit-test execution rate before acceptance (%) | 62 [55–70] | 83 [77–88] |
| First-attempt acceptance pass rate (%) | 71 [65–78] | 84 [79–89] |
| Dispute rate (per 100 accepted stories) | 9.0 [6.0–13.0] | 3.0 [2.0–5.0] |
| Communication round-trips per issue | 7.0 [5.0–9.0] | 4.0 [3.0–6.0] |
| Governance & accountability | ||
| Test-case assignment | Off-chain (manual/tools) | On-chain, auditable |
| Acceptance criteria evidence | Logs in CI/tracker | On-chain events + hashed artifacts |
| Payment/compensation linkage | Off-process/manual | Smart-contract escrow; acceptance-linked |
| Dispute resolution | Off-chain tickets/email | On-chain escrow + multisig workflow |
| Security & integrity | ||
| Tamper evidence for test states | Limited (mutable logs) | Immutable ledger entries |
| Performance overhead | ||
| TX latency p50 (ms, LAN) | — | ~230 [190–280] |
| TX latency p95 (ms, WAN) | — | ~780 [680–860] |
| Throughput at peak (tx/s, LAN) | — | ~115 [105–125] |
| Gas per event (Acceptance Verdict) (gas) | — | ~58,000 [54k–62k] |
| Gas per event (Payout) (gas) | — | ~77,000 [72k–81k] |
| Privacy | ||
| On-chain personal data | N/A | None; hashes/metadata only |
| Axis | OSSAPTestingPlus (Yours) | Saleh 2025 (BC-CI/CD) | DeQL eScience 2025 | SLSA/Attestations (Baseline) | 2025 SC-Verification Surveys |
|---|---|---|---|---|---|
| Primary aim | In-lifecycle acceptance enforcement + payment | Secure pipeline logging & integrity | Decentralized orchestration of code analysis | Provenance & tamper-evident build chains | Catalog & assess verification methods/tools |
| Ledger role | Control + settlement | Audit/coordination | Orchestration signals | None (PKI/rekor-style stores) | N/A (off-chain methods) |
| Point of integration | Before & during tests (gates), then pay | Pipeline stages (post-event write) | Pre-commit/code-analysis flow | Build/release provenance | Design & verification phase |
| Acceptance criteria | Encoded in contracts (pass ⇒ pay) | Implied via policies; off-chain verify | External to chain | Policy in provenance; off-chain verify | Patterns/specs for properties |
| Incentives/payments | Automatic settlement | No | No | No | No |
| Provenance model | Domain-specific hashes/KPIs (photogrammetry) | Generic pipeline events | Generic pre-commit metadata | SBOM + provenance attestations | Property/spec catalogs, tool taxonomies |
| Governance | Permissioned validators (OSSAP roles) | Not specified | Not specified | OpenSSF ecosystem/process | Research guidance, not runtime governance |
| Scope | Distributed agile QA in OSSAP | Cloud CI/CD security | Collaborative sciences CI/CD | Supply-chain security for all SW | Smart-contract QA landscape |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Aziz, O.; Farooq, M.S.; Qureshi, J.N.; Manzoor, M.F.; Shaheen, M. OSSAPTestingPlus: A Blockchain-Based Collaborative Framework for Enhancing Trust and Integrity in Distributed Agile Testing of Archaeological Photogrammetry Open-Source Software. Information 2025, 16, 992. https://doi.org/10.3390/info16110992
Aziz O, Farooq MS, Qureshi JN, Manzoor MF, Shaheen M. OSSAPTestingPlus: A Blockchain-Based Collaborative Framework for Enhancing Trust and Integrity in Distributed Agile Testing of Archaeological Photogrammetry Open-Source Software. Information. 2025; 16(11):992. https://doi.org/10.3390/info16110992
Chicago/Turabian StyleAziz, Omer, Muhammad Shoaib Farooq, Junaid Nasir Qureshi, Muhammad Faraz Manzoor, and Momina Shaheen. 2025. "OSSAPTestingPlus: A Blockchain-Based Collaborative Framework for Enhancing Trust and Integrity in Distributed Agile Testing of Archaeological Photogrammetry Open-Source Software" Information 16, no. 11: 992. https://doi.org/10.3390/info16110992
APA StyleAziz, O., Farooq, M. S., Qureshi, J. N., Manzoor, M. F., & Shaheen, M. (2025). OSSAPTestingPlus: A Blockchain-Based Collaborative Framework for Enhancing Trust and Integrity in Distributed Agile Testing of Archaeological Photogrammetry Open-Source Software. Information, 16(11), 992. https://doi.org/10.3390/info16110992

