Featured Application
This work can be used as benchmark for performance evaluation of tools to improve supply chain management in general and solid biofuel supply chain in particular. The potential application is for integrated goods distribution management that promotes efficient resource utilization and sustainability.
Abstract
The paper presents a report on the performance evaluation of a newly developed smart logistics system (SLS). Field tests were conducted in Spain, Germany, and Sweden. The evaluation focused on the performance of a smart box tool (used to capture information during biomass transport) and a web-based information platform (used to monitor the flow of agricultural pruning from farms to end users and associated information flow). The tests were performed following a product usability testing approach, considering both qualitative and quantitative parameters. The detailed performance evaluation included the following: systematic analysis of 41 recordable parameters (stored in a spreadsheet database), analysis of feedback and problems encountered during the tests, and overall quality analysis applying the product quality model adapted from ISO/IEC FDIS 9126-1 standard. The data recording and storage and the capability to support product traceability and supply chain management were found to be very satisfactory, while assembly of smart box components (mainly the associated cables), data transferring intervals, and manageability could be improved. From the data retrieved during test activities, in more than 95% of the parameters within 41 columns, the expected values were displayed correctly. Some errors were observed, which might have been caused mainly by barriers that could hinder proper data recording and transfer from the smart box to the central database. These problems can be counteracted and the performance of the SLS can be improved so that it can be upgraded to be a marketable tool that can promote sustainable biomass-to-energy value chains.
1. Introduction
The use of pruning biomass for renewable energy production is one of the renewable energy uses being promoted in Europe. This study was part of an EU EuroPruning project, “Development and implementation of a new and non-existent logistics chain for biomass from pruning”, which was aimed at developing improved logistics chains for biomass from agricultural pruning residues []. This includes the development of a new decision tool for a pruning biomass trading system and logistics management (see Figure 1 and Figure 2). To fulfill this, a smart logistics system (SLS) was developed as described by Gebresenbet et al. []. Computer technology has changed the historical face-to-face communication in trading systems [], and the SLS enables utilization of recent technology.
Figure 1.
Typical pruning biomass logistics chain.
Figure 2.
Different stages of logistics chain in the process of biomass-to-energy conversion.
Understanding and managing the material and information flow (see Figure 1) enables efficient and effective utilization of resources. The SLS developed for this purpose has been reported in detail in []. But there are associated research questions: What is the performance of the SLS tool in real conditions? What is the feedback of end users of the tool?
The objective of this study was to evaluate the performance of the SLS under field conditions. This is important, as the SLS is a newly developed tool and evaluating its performance is important. This report describes the methodology applied and the results obtained from applying the SLS tool in real conditions. This is important for replication of the study and improvement of the SLS tool.
1.1. Pruning Biomass Logistics Chain
Figure 1 and Figure 2 describe activities at different stages of a logistics chain. Pruning fruit trees (removing top or unwanted branches) (see Figure 2a) is done by farmers on an annual or biennial basis to maintain the desired tree form and structure and to increase the productivity of fruit trees. Pruning harvesting is often integrated with chipping or baling (see Figure 2b). The harvested product can be stored in the form of bales or chips (see Figure 2c).
Storage of biomass is related to seasonal variability and logistics operation cost, and storage locations should be efficient to reduce transportation and operation costs. The location of biomass storage can vary depending on the nature of the biomass supply chain []: on-field storage, intermediate storage (between the fields and power plants), and storage facility at the biomass power plant. Biomass transportation is an important activity in biomass-to-energy systems. This includes both on-farm transportation and main transportation (from farm to storage or power plant).
1.2. Smart Logistics System and Its Utilization by Different Actors
The SLS has four major components, as indicated in Figure 3 and presented in detail by Gebresenbet et al. []. The smart box is a sensor unit for measuring parameters such as relative humidity, temperature, geographic position, and route tracking, and information associated with quick read (QR) codes. The onboard control unit is used for planning transport routes and monitoring recordings by Cargolog. The information platform is used for documentation and data sharing, and to facilitate biomass trading and management of the pruning supply chain and traceability. The central control unit is a point of administration of the biomass trading and logistics system and links the information platform and onboard control unit.
Figure 3.
Major components of the smart logistics system. Reproduced from permission of [] (MDPI, 2018).
The two components of the SLS (the smart box and information platform) have been integrated so that the smart box is functionally connected with the web address of the information platform []. The smart box records and transmits data to the central information platform. The information platform is designed to facilitate interactions among biomass supply chain actors and data collection, as well as the management of the entire logistics of the pruning biomass supply chain (see Figure 2 and Table 1). Table 1 presents how different actors use the platform to interact regarding the flow of materials and related information along the pruning biomass supply chain.
Table 1.
Actions to be performed by main actors of the pruning supply chain.
The SLS will be used to improve the performance of the biomass supply chain focusing on pruning biomass. In evaluating the performance of supply chain management, it is important to identify the performance measurement metrics within the context of the supply chain under evaluation []. The overall performance of a supply chain depends on the role of each stakeholder in the chain [,]. Shashi et al. [] discussed that stakeholders’ interest, value addition, and partners’ performance play important roles in the overall performance of a supply chain.
2. Testing and Evaluation Methodology
2.1. Usability Testing
Usability testing is an evaluation method that has the largest impact on product []. It is one method of evaluating the learning and use of new products. In this study, the usability testing approach was used considering six basic characteristics: system to evaluate, focus, participants, tasks, data, and results []. These characteristics were applied as explained in Table 2. Both qualitative and quantitative data analyses were used in the evaluation of SLS.
Table 2.
Usability testing characteristics.
2.2. Metrics and Product Quality Model for Evaluation of SLS
2.2.1. Metrics for Performance Evaluation
The SLS deals with data recording, transfer, and storage in a centralized database through the integrated action of a smart box and a web-based information platform (see Figure 3). The functional features of the smart box tool and information platform were integrated using Cargolog PC software, Cargolog FAT90 V2 (Mobitron, Huskvarna, Sweden). In this report, as part of the evaluation of the smart system, metrics were selected and adapted from international standards for systems and software quality requirements and evaluation (ISO/IEC 25010:2011) as described in [] and Table 3.
Table 3.
Quality attributes considered for performance evaluation of the SLS.
2.2.2. Product Quality Model
The general product quality model for internal and external quality evaluation of information technology (software product) described in ISO/IEC FDIS 9126-1 (see Figure 4) was adapted for evaluation of the smart system []. The evaluation is based on the definitions given in international standards for information technology–based product quality (ISO/IEC FDIS 9126-1) as indicated in Table 3 and Figure 4. The detailed analysis results are presented in Table 9.
Figure 4.
Product quality model for internal and external quality assessment (adapted with modification from ISO/IEC FDIS 9126-1).
2.3. Smart System Testing
2.3.1. Smart Box Installation and Training
Before starting the actual testing in Sweden, Spain, and Germany, training/guidance was provided on proper installation and operation of the smart system. In addition to this training, two user guide documents were prepared and provided to actors involved in testing the tool. The first user guide enables smart box users to install Cargolog PC software on computers for onboard monitoring purposes and to mount the smart box tool (with metal case) appropriately on the truck (see Figure 5). The second guide enables users to use the information platform efficiently.
Figure 5.
(a) Smart Box assembly: (1) smart box protected with metal case; (2) GPRS/GSM antenna; (3) Global Positioning System (GPS) antenna; (4) temperature and humidity measuring sensor probe; (5) power cable. (b) PowerTM 9500 scanner with its components.
2.3.2. Smart System Field Testing
In this study, three prototypes were developed. The testing and evaluation activities were done with all the three prototypes during 2015–2016. Although testing of the smart system was done during different stages of the development of the system, this report presents only the testing and evaluation results of the final smart system prototype used by end users during final testing activities. The smart boxes were used at farm-to-storage and storage-to-consumer transport stages.
3. Evaluation Results and Discussion
3.1. Data Retrieved from Central Database of the Smart System
In the spreadsheet-based central database, the data are stored in 41 columns (see Table 4 and Appendix A). Data entered by actors directly on the platform and data transferred from the smart box are stored mainly in the 41 columns, while some additional information can be displayed and visualized on the platform. It is important to test the performance of the smart system by considering how correctly the recorded values and information are displayed in each of the 41 columns. This enables us to understand the performance of the smart system and identify the columns where incorrect information might be displayed. In general, during this test, about 104 records of product lines (with specific lot numbers) were retrieved from the SLS database. This in turn enabled us to identify functional features of the SLS linked to errors in displayed values and to figure out what further improvement would be needed to upgrade the system.
Table 4.
Parameters and how they are implemented in the spreadsheet-based database on the platform server under 41 columns.
3.2. Data on Product Delivery Information
Using the SLS tool, the system administrator can easily identify products entered into the system, products for which transport routes are planned, and products that have been delivered to end users. Table 5 indicates that, out of the recorded 104 products, route planning was tested for 54%, while actual product delivery of 16% was confirmed according to the data captured by the smart system.
Table 5.
Number of products registered in platform during field testing.
3.3. Data Recorded and Visualized Directly on Platform
The feedback from users regarding the attractiveness and user-friendliness of the functional features of the smart system is very important to improve the system. The feedback may be on utilization of functional features to perform specific actions and/or visualize the results.
Samples of visualizations of recorded data are presented in Figure 6, Figure 7, Figure 8 and Figure 9, which describe information gathered with smart box 2015085119 (see Figure 6) at a test site in Germany during transport of pruning products registered as Field3, lot number 151008B03R1.
Figure 6.
Visualization of smart box reading link indicating its Cargolog serial number.
Figure 7.
Visualization of measured parameter values (temperature and humidity as recorded on 21 December 2015, from 08:29:14 to 11:32:02 and displayed as a table).
Figure 8.
Delivery route based on GPS coordinates recorded by the smart box.
Figure 9.
Example of smart box reading visualization: graphic presentation of measured parameters (along with displayed values of temperature, humidity, and GPS coordinates as recorded on 21 December 2015, from 08:29:14 to 11:32:02).
The relative humidity data retrieved from the testing activity in Germany are presented in Table 6, together with the moisture content of the biomass at the storage site. It must be noted that relative humidity indicates the humidity in the air inside the truck box after loading the woodchips. In the initial moment, the moisture measured was just the air moisture at the site. Once the probe (see Figure 5a) was inserted into the truck box, the air in the internal void volume among the woodchips increased its moisture content until it reached equilibrium with the moisture of the woodchips.
Table 6.
Example of moisture content data compiled from test in Germany.
3.4. Information Flow and Product Traceability Performance of the Smart System
The information gathered using the smart system was rich enough to construct an effective traceability map of each registered product along the pruning supply chain []. Detailed pruning quality parameters and the product traceability system are provided in [,]. The SLS was integrated with the biomass traceability system, with pruning quality and related traceability parameters. The usability testing indicated that all of the traceability-related parameters were implemented on the information platform of the SLS (see Figure 3). The identification of producers (provider ID), transporters (transporter ID), and consumers (consumer ID), and the specific name (title) and production lot number assigned to each registered product are mandatory parameters to trace product movement along the pruning supply chain (see Table 4). Table 7 indicates that except for smart box number (Cargolog serial no.), delivery code, pickup date, and delivery date, all important parameters are recorded correctly. The errors in records of Cargolog serial no., pickup date, and delivery date could be mainly due to barriers in data transfer from the smart box to the central database. In the case of Spain, the Cargolog serial no., pickup date, and delivery date were not recorded at all in the central database, indicating that the information was not properly transferred from the smart box tool to the central database.
Table 7.
Major parameters for traceability information continuity and their recording performance
For illustration purposes, a product from the test in Germany is considered here. For a product registered with the title “Field7” and lot number 151008B05R1, the producer, transporter, and consumer are identified as FDEU020, DDEU012, and CDEU013, respectively (see Appendix A). The corresponding complete product identification code can be constructed as FDEU020-DDEU012-CDEU013. Whenever a product traceability issue is initiated, further detailed traceability-related information can be retrieved from gathered data for each stage of the logistics chain. This can be done by an experienced administrator of the smart system who can interpret all recorded values in each of the 41 columns of the spreadsheet-based central database. The data barriers in delivery date (column 38) and Cargolog serial number (column 7) may hinder the system administrator from confirming the final delivery of the product to the intended consumer. In such cases, the administrator should find additional information by telephone or internet conversation, for instance, by introducing an option (on the platform) for the end consumer to confirm the product delivery. This enables the system administrator to easily construct the product delivery identification code and strengthen the traceability and management of the entire pruning supply [].
The smart system was developed to effectively gather, monitor, store, and analyze data to improve pruning logistics management (even though the tool could be utilized for any biomass supply chain). As indicated in Table 8, this integrated system enables improved performance of pruning supply chain management and product traceability by reducing biomass loss (in terms of quality and quantity), increasing the quality of solid fuel and delivery service, and reducing logistics and transaction costs [,,]. Therefore, evaluation results indicate that the SLS is important tool for management of the biomass value chain and trading system. It enables tracing and tracking of the product, controls product quality, facilitates information flow, reduces management cost, and enables managers to manage the entire supply chain. Table 8 indicates that most of the major functional features performed satisfactorily.
Table 8.
Analysis results of overall satisfactory level of major functionalities.
3.5. Evaluation of Smart System Using Product Quality Model
In this section, the product quality model is used to analyze the performance of the smart system. The feedback from the testing was systematically used as input information for the product quality model. This input includes observations of the experts participating in testing the tool (see Table 9).
Table 9.
Evaluation of the SLS using product quality model for internal and external quality assessment (adapted with modification from ISO/IEC FDIS 9126-1).
3.6. Major Recommended Improvements
When the SLS was conceived, it was designed for use in supporting and improving biomass logistics, not only for pruning biomass, but for any type of biomass, such as forestry woodchips and herbaceous agrarian residues. For this purpose, further improvements are suggested so that the SLS can be effectively adapted for biomass-to-energy businesses. The performance test results indicate that the SLS performs data collection and storage in the central database satisfactorily. The stored data and other relevant information enable the tool to support product traceability and supply chain management very effectively. For further improvement and service quality, assembly of the smart box components (mainly the associated cables) and data transfer intervals as well as column arrangement in the spreadsheet format for data storage could be improved more.
In general, each batch of pruning biomass data entered into the online platform directly by actors (farmers, traders, etc.) was found to be well documented in the central database and easily visualized by intended users. However, some errors were noticed regarding data on parameters measured by the smart box (such as relative humidity, temperature, Global Positioning System (GPS) coordinates during biomass transport) and transmitted to the database. These errors may be caused by improper initialization of the smart box, unplugging the power cables before data transmission is complete, or unexpected barriers that could interrupt data transmission from the smart box to the online platform.
The smart system enables users to determine the transport distance and truck speed at the route planning stage. However, the real routes followed during transport are displayed only on maps. The actual driving distance and time (or speed) are not determined and displayed along the route maps. Through further improvement, these values can be either displayed on the maps or documented in the spreadsheet-based central database. To increase effective utilization of the information platform, additional functional options should be created (on the platform interface) for transporters and end consumers where they can confirm product delivery and acceptance, respectively. In addition, a billing system could be included as a component to facilitate trading of biomass products.
4. Conclusions
The testing and evaluation of a smart logistics system was carried out in order to identify functional limitations and important improvements to be implemented. The functional features of the smart box and centralized information platform were considered during testing. The features were designed to enable users to have an effective information acquisition, monitoring, and utilization system while promoting sustainable pruning for the energy value chain. All three smart box prototypes were tested together with the information platform. Based on tests done in Spain, Germany, and Sweden, the performance evaluation of the smart system was carried out by systematically analyzing:
- ➣
- values of parameters recorded and stored in the spreadsheet database with 41 columns (for each pruning product registered with a specific lot number),
- ➣
- feedback and problems encountered during the test, and
- ➣
- selected performance metrics in relation to product quality model adapted from ISO/IEC FDIS 9126-1 standard.
The performance test results indicate that the smart system satisfactorily performed data collection and storage in the central database. The stored data and other relevant information enabled the tool to support product traceability and supply chain management very effectively.
In general, for each batch of pruning biomass (with specific lot number) entering and leaving the biomass supply chain, data entered into the online platform directly by actors (farmers, traders, etc.) were well documented in the central database and easily visualized by intended users. The information platform enabled users to display the locations of pruning farms, biomass storage and processing sites, energy plants, and the planned and/or actual delivery routes according to the needs of different actors, such as raw materials producers, traders, and consumers. However, some errors were noticed regarding the smart box identification numbers (expected to be transferred from the smart box to the central database during product pickup and delivery), product delivery codes (expected to be generated by the smart system), and product pickup and delivery times. These errors might have been caused by improper initialization (while triggering the smart box with a power scan), unplugging the power cables before data transmission was complete, or unexpected barriers that interrupted data transmission from the smart box to the online platform. To counteract these problems and increase information continuity along the pruning supply chain as well as effective utilization of the smart system, additional functional features should be created so that transporters and consumers can confirm product delivery and acceptance, respectively. This option enables retrieval of important information that could be missed due to problems encountered by the smart box during data transfer to the central database and increases system performance so that it can be upgraded to a marketable tool promoting sustainable biomass development for renewable energy generation.
Author Contributions
G.G. and S.-O.O. conceptualized the validation the SLS. G.G., D.G., T.B. and S.-O.O. designed the methodology of performance evaluation of SLS. S.-O.O., D.G., T.B., and S.G. participated in field test activities, monitoring and providing feedback for the development of SLS. T.B. wrote the paper while G.G. reviewed it.
Funding
This research was funded by the European Union Seventh Framework Programme (FP7/2007-2013), grant number 312078. This work was part of international EuroPruning project, “Development and implementation of a new and non-existent logistics chain for biomass from pruning”.
Conflicts of Interest
The authors declare no conflict of interest.
Appendix A
Table A1.
Sample of data recorded and stored in Spreadsheet data base during Smart System testing in Germany.
Table A1.
Sample of data recorded and stored in Spreadsheet data base during Smart System testing in Germany.
| 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 |
| title | status | Provider ID | Transporter ID | Consumer ID | Shipment ID | Cargolog Serial No | Delivery Code | latitude | longitude | Destination Longitude |
| ATBTest | ordered | FSWE001 | DDEU012 | CSWE001 | 2015085119 | FSWE001-CSWE001 | 52.403554 | 13.063443 | 13.97707995 | |
| ATBTest2 | ordered | FSWE001 | DDEU012 | CSWE001 | 2015085119 | FSWE001-CSWE001 | 52.305625 | 12.836196 | 13.9770799 | |
| ATBTest3 | ordered | FSWE001 | DDEU012 | CSWE001 | 2015085119 | FSWE001-CSWE001 | 52.484537 | 12.838255 | 13.9770799 | |
| ATBTest4 | ordered | FSWE001 | DDEU012 | CSWE001 | 2015085119 | FSWE001-CSWE001 | 52.277906 | 13.141066 | 13.9770799 | |
| ATBTest5 | ordered | FSWE001 | DDEU012 | CSWE001 | 2015085119 | FSWE001-CSWE001 | 52.514216 | 12.904860 | 13.9770799 | |
| Delivery 02 | routed | FDEU004 | DSWE001 | CSWE001 | 21 | FDEU004-CSWE001 | 51.1656 | 10.45152600 | 13.9770799 | |
| Field 1 | routed | FDEU020 | DDEU012 | CDEU014 | 78 | 2015085119 | FDEU020-CDEU014 | 52.373172 | 12.879107 | 12.9964099 |
| Field 2 | ordered | FDEU020 | DDEU012 | CDEU011 | FDEU020-CDEU011 | 52.390351 | 12.732488 | 13.3759440 | ||
| Field 4 | ready | FDEU020 | 52.450598 | 12.833617 | ||||||
| Field 3 | routed | FDEU020 | DDEU012 | CDEU015 | 80 | 2015085119 | FDEU020-CDEU015 | 52.373889 | 12.854585 | 13.7257835 |
| Field 8 | routed | FDEU020 | DDEU012 | CDEU013 | 67 | FDEU020-CDEU013 | 52.36694 | 12.87653 | 12.6542489 | |
| 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19 | 20 | 21 | |
| title | Destination Latitude | Lot Number | quantity | species | Origin Classification | Traded Form | Particle Size | Bale Diameter | Moisture Content | Ash Content |
| ATBTest | 57.74525490 | 151012B01R1 | 3.0000 | Lemon | 1.1.1.1 | chips | ||||
| ATBTest2 | 57.74525490 | 151016B01R1 | 6.0000 | Orange | 1.1.1.1 | chips | P16A | |||
| ATBTest3 | 57.74525490 | 151016B02R1 | 10.0000 | Tangerine | 1.1.1.1 | branches | P16A | |||
| ATBTest4 | 57.74525490 | 151016B03R1 | 50.0000 | Apple | 1.1.1.1 | bale_round | 1.20 | |||
| ATBTest5 | 57.74525490 | 151016B04R1 | 60.0000 | Plum | 1.1.1.1 | chips | ||||
| Delivery 02 | 57.7452549 | 141127N01R1 | 3.0000 | Cherry | 1.1.1.4 | chips | P45A | 1.00 | 60.00 | 2.00 |
| Field 1 | 52.47596 | 151007B01R1 | 1.9000 | Apple | 1.1.1.1 | bale_round | 1.20 | |||
| Field 2 | 52.509649 | 151008B01R1 | 13.0000 | Apple | 1.1.1.1 | bale_round | 1.20 | |||
| Field 4 | 151008B02R1 | 1.0000 | Cherry | 1.1.1.1 | bale_round | 1.00 | ||||
| Field 3 | 51.6350451 | 151008B03R1 | 0.6000 | Cherry | 1.1.1.1 | bale_round | 1.00 | |||
| Field 8 | 53.5605655 | 151008B04R1 | 2.6000 | Apple | 1.1.1.1 | bale_round | 1.20 | |||
| Field 7 | 53.5605655 | 151008B05R1 | 8.3000 | Apple | 1.1.1.1 | bale_round | 1.20 | |||
| 22 | 23 | 24 | 25 | 26 | 27 | 28 | 29 | 30 | 31 | |
| title | Density Chips | Density Bale | Calorific Value | Crop Characteristics | Pruning Date | Collection Date | Storage Days | piled | Chemically Treated | covered |
| ATBTest | 14 April 2015 | 4 May 2015 | 150 | 0 | 0 | 0 | ||||
| ATBTest2 | 4 October 2015 | 5 October 2015 | 10 | 0 | 0 | 0 | ||||
| ATBTest3 | 1 September 2015 | 5 October 2015 | 20 | 0 | 0 | 0 | ||||
| ATBTest4 | 9 August 2015 | 14 August 2015 | 30 | 0 | 0 | 0 | ||||
| ATBTest5 | 8 June 2015 | 17 August 2015 | 60 | 0 | 0 | 0 | ||||
| Delivery 02 | 2.00 | 1.00 | 1.00 | 27 November 2015 | 28 November 2014 | 2 | 1 | 1 | 1 | |
| Field 1 | 23 February 2014 | 9 March 2014 | 180 | 1 | 0 | 0 | ||||
| Field 2 | 4 March 2015 | 16 October 2014 | 180 | 1 | 0 | 0 | ||||
| Field 4 | 25 February 2014 | 18 March 2014 | 180 | 1 | 0 | 0 | ||||
| Field 3 | 23 March 2014 | 26 March 2015 | 180 | 1 | 0 | 0 | ||||
| Field 8 | 26 March 2014 | 30 March 2015 | 180 | 1 | 0 | 0 | ||||
| Field 7 | 27 March 2014 | 14 November 2015 | 180 | 1 | 0 | 0 | ||||
| 32 | 33 | 34 | 35 | 36 | 37 | 38 | 39 | 40 | 41 | |
| title | moved | contaminated | Use Storage | Storage Longitude | Storage Latitude | Pickup Date | Delivery Date | Created Date | Modified Date | Modified By User ID |
| ATBTest | 0 | 0 | 1 | 13.012569 | 52.43828 | 15 October 2015 08:32 | 15 October 2015 11:56 | 12 October 2015 09:22 | 18 November 2015 11:04 | DDEU012 |
| ATBTest2 | 0 | 0 | 0 | 16 October 2015 07:59 | 16 October 2015 09:11 | 16 October 2015 08:27 | 16 November 2015 10:02 | DDEU012 | ||
| ATBTest3 | 0 | 0 | 0 | 16 October 2015 12:09 | 16 October 2015 08:32 | 18 November 2015 11:04 | DDEU012 | |||
| ATBTest4 | 0 | 0 | 0 | 16 October 2015 09:38 | 16 October 2015 12:09 | 16 October 2015 08:33 | 18 November 2015 11:04 | DDEU012 | ||
| ATBTest5 | 0 | 0 | 0 | 16 October 2015 10:20 | 16 October 2015 12:09 | 16 October 2015 09:27 | 18 November 2015 11:04 | DDEU012 | ||
| Delivery 02 | 1 | 0 | 0 | 27 November 2015 12:01 | 31 March 2015 08:01 | DSWE001 | ||||
| Field 1 | 1 | 1 | 0 | 18 December 2015 08:56 | 8 October 2015 14:59 | 21 December 2015 08:14 | DDEU012 | |||
| Field 2 | 1 | 1 | 0 | 8 October 2015 15:02 | 21 December 2015 08:08 | DDEU012 | ||||
| Field 4 | 1 | 1 | 0 | 8 October 2015 15:04 | 8 October 2015 15:19 | FDEU020 | ||||
| Field 3 | 1 | 0 | 0 | 21 December 2015 08:29 | 21 December 2015 11:32 | 8 October 2015 15:11 | 8 February 2016 10:18 | DDEU012 | ||
| Field 8 | 1 | 1 | 0 | 8 October 2015 15:15 | 18 November 2015 11:04 | DDEU012 | ||||
| Field 7 | 1 | 0 | 0 | 17 November 2015 11:17 | 19 November 2015 11:23 | 8 October 2015 15:17 | 19 November 2015 11:39 | DDEU012 |
References
- EuroPruning. Available online: http://www.europruning.eu (accessed on 28 December 2017).
- Gebresenbet, G.; Bosona, T.; Olsson, S.-O.; Garcia, D. Smart System for the Optimization of Logistics Performance of the Pruning Biomass Value Chain. Appl. Sci 2018, 8, 1162. [Google Scholar] [CrossRef]
- Hendershott, T. Electronic trading in financial markets. IT Prof. 2003, 4, 10–14. [Google Scholar] [CrossRef]
- Iakovou, E.; Karagiannidis, A.; Vlachos, D.; Toka, A.; Malamakis, A. Waste biomass-to-energy supply chain management: A critical synthesis. Waste Manag. 2010, 30, 1860–1870. [Google Scholar] [CrossRef] [PubMed]
- Europruning Application Platform. Available online: http://europruning.mobitron.se/public/en (accessed on 16 July 2018).
- Cerchione, S.; Cerchione, R.; Singh, R.; Centobelli, P.; Shabani, A. Food cold chain management: From a structured literature review to a conceptual framework and research agenda. Int. J. Logist. Manag. 2018, 29, 792–821. [Google Scholar] [CrossRef]
- Seuring, S.; Muller, M. From a literature review to a conceptual framework for sustainable supply chain management. J. Clean Prod. 2008, 16, 1699–1710. [Google Scholar] [CrossRef]
- Dumas, J.S.; Fox, J.E. Usability testing: Current practice and future directions. In Human-Computer Interaction: Development Process; Book Chapter; CRC Press: Boca Raton, FL, USA, 2009; pp. 232–253. Available online: https://www.taylorfrancis.com/books/e/9781420088892/chapters/10.1201%2F9781420088892-18 (accessed on 18 October 2018).
- ISO/IEC 25010:2011(en). Systems and Software Engineering-Systems and Software Quality Requirements and Evaluation (Square)-System and Software Quality Models. Available online: https://www.iso.org/obp/ui/#iso:std:iso-iec:25010:ed-1:v1:en (accessed on 23 July 2018).
- ISO/IEC (2000). Information Technology—Software Product Quality—Part 1: Quality Model. ISO/IEC FDIS 9126-1. Available online: http://www.cse.unsw.edu.au/~cs3710/PMmaterials/Resources/9126-1%20Standard.pdf (accessed on 24 March 2016).
- Bosona, T.; Gebresenbet, G.; Olsson, S.-O. Traceability System for Improved Utilization of Solid Biofuel from Agricultural Prunings. Sustainability 2018, 10, 258. [Google Scholar] [CrossRef]
- CIRCE (2014). Description of the Biomass Specifications for the Value Chain. Deliverable 2.1 of EuroPruning Project. Available online: http://www.europruning.eu/web/lists/pubfiles.aspx?type=pubdeliverables (accessed on 29 May 2017).
- Smart Logistics and Cost-Effective Transportation. Available online: http://www.europruning.eu/web/data/category.aspx?id=smartlogistics (accessed on 30 December 2017).
- Santa, J.; Zamora-Izquierdo, M.A.; Jara, A.J.; Gómez-Skarmeta, A.F. Telematic platform for integral management of agricultural/perishable goods in terrestrial logistics. Comput. Electron. Agric. 2012, 80, 31–40. [Google Scholar] [CrossRef]
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).