Semantic Reasoning of Product Biologically Inspired Design Based on BERT
Abstract
:1. Introduction
1.1. Product Biologically Inspired Design
1.2. Bionic Reasoning
1.3. Bidirectional Encoder Representations from Transformers (BERT) Pretraining Model
2. Experiment
2.1. Study 1: Bionic Reasoning Experiment from Product to Biology
2.1.1. Subjects
2.1.2. Stimuli
2.1.3. Procedure
2.1.4. Results
2.2. Study 2: Bionic Reasoning Experiment from Biology to Product
2.2.1. Subjects
2.2.2. Stimuli
2.2.3. Procedure
2.2.4. Results
2.3. Discussion
3. Methodology
3.1. Product and Biology Semantic Database
3.2. Product-Organism Semantic Similarity Calculation
3.3. Semantic Reasoning of Product BID Based on BERT
3.4. Example
4. Discussion and Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Alipour, L.; Faizi, M.; Moradi, A.M.; Gholamreza, A. The impact of designers’ goals on design-by-analogy. Des. Stud. 2017, 51, 1–24. [Google Scholar] [CrossRef]
- Nachtigall, W.; Wisser, A. Building and climatization. In Bionics by Examples, 1st ed.; Springer: Cham, Switzerland, 2015; pp. 117–133. [Google Scholar]
- Aziz, M.S. Biomimicry as an approach for bio-inspired structure with the aid of computation. Alex. Eng. J. 2016, 55, 707–714. [Google Scholar] [CrossRef] [Green Version]
- Neurohr, R.; Dragomirescu, C. Bionics in engineering-defining new goals in engineering education at “politehnica” university of bucharest. Conf. Eng. Educ. 2007, 1, 3–6. Available online: http://icee2007.dei.uc.pt/proceedings/papers/571.pdf (accessed on 13 December 2021).
- Helms, M.; Vattam, S.S.; Goel, A.K. Biologically inspired design: Process and products. Des. Stud. 2009, 30, 606–622. [Google Scholar] [CrossRef]
- Chai, C.; Cen, F.; Ruan, W.; Yang, C.; Li, H. Behavioral analysis of analogical reasoning in design: Differences among designers with different expertise levels. Des. Stud. 2015, 36, 3–30. [Google Scholar] [CrossRef]
- Luo, S.; Bian, Z.; Hu, Y. How can biological shapes inspire design activity in closed domains? Int. J. Technol. Des. Educ. 2020, 1–27. Available online: https://link.springer.com/article/10.1007/s10798-020-09593-y (accessed on 13 December 2021). [CrossRef]
- Cheong, H.; Shu, L.H. Using templates and mapping strategies to support analogical transfer in biomimetic design. Des. Stud. 2013, 34, 706–728. [Google Scholar] [CrossRef]
- Mak, T.W.; Shu, L.H. Using descriptions of biological phenomena for idea generation. Res. Eng. Des. 2008, 19, 21–28. Available online: https://link.springer.com/article/10.1007%2Fs00163-007-0041-y (accessed on 13 December 2021). [CrossRef]
- Shu, L.H.; Cheong, H. A Natural Language Approach to Biomimetic Design. In Biologically Inspired Design, 1st ed.; Goel, A.K., McAdams, D.A., Stone, R.B., Eds.; Springer: Cham, Switzerland, 2015; pp. 29–61. [Google Scholar] [CrossRef] [Green Version]
- Chiu, I.; Shu, L.H. Bridging cross-domain terminology for biomimetic design. In Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, Long Beach, CA, USA, 24–28 September 2005; ASME: New York, NY, USA, 2008; Volume 4742, pp. 93–101. [Google Scholar] [CrossRef]
- Chiu, I.; Shu, L.H. Biomimetic design through natural language analysis to facilitate cross-domain information retrieval. AI EDAM 2007, 21, 45–59. [Google Scholar] [CrossRef]
- Cheong, H.; Shu, L.H.; Stone, R.B.; McAdams, D.A. Translating terms of the functional basis into biologically meaningful keywords. In Proceedings of the International Design Engineering Technical Conferences and Computers and Information in Engineering Conference, New York, NY, USA, 3–6 August 2008; ASME: New York, NY, USA, 2009; Volume 43284, pp. 137–148. [Google Scholar] [CrossRef] [Green Version]
- Luo, S.; Zhang, Y.; Zhang, J.; Xu, J.H. A User Biology Preference Prediction Model Based on the Perceptual Evaluations of Designers for Biologically Inspired Design. Symmetry 2020, 12, 1860. [Google Scholar] [CrossRef]
- Yuan, X.Q.; Chen, D.K.; Ynag, Y.P.; Qi, B. Bionic imagery associated with product form design. Comput. Eng. Appl. 2014, 50, 178–182. [Google Scholar] [CrossRef]
- Luo, S.J.; Bian, Z.; Zhang, Y.F.; Lu, J.W.; Lu, S.Z. A study on product bionic fusion design based on shape matching. Comput. Integr. Manuf. Syst. 2020, 26, 2633–2641. [Google Scholar] [CrossRef]
- Zhu, H. Cognitive Coupling Based Product Image Morphology Bionic Evolutionary Design Method. Master’s Thesis, Lanzhou University of Technology, Lanzhou, China, 2018. [Google Scholar]
- Devlin, J.; Chang, M.W.; Lee, K.; Toutanova, K. Bert: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL HLT, Minneapolis, MN, USA, 2–7 June 2019; Volume 1, pp. 4171–4186. [Google Scholar]
- Zhang, Z.; Wu, S.; Jiang, D.W.; Chen, G. BERT-JAM: Maximizing the utilization of BERT for neural machine translation. Neurocomputing 2021, 460, 84–94. [Google Scholar] [CrossRef]
- Harnoune, A.; Rhanoui, M.; Mikram, M.; Yosifi, S.; Elkaimbillah, Z.; Asri, B.E. BERT Based Clinical Knowledge Extraction for Biomedical Knowledge Graph Construction and Analysis. Comput. Methods Programs Biomed. Update 2021, 1, 100042. [Google Scholar] [CrossRef]
- Shah, S.M.A.; Taju, S.W.; Ho, Q.T.; Nguyen, T.T.D.; Qu, Y.Y. GT-Finder: Classify the family of glucose transporters with pre-trained BERT language models. Comput. Biol. Med. 2021, 131, 104259. [Google Scholar] [CrossRef] [PubMed]
- Wu, Z.; Liang, J.; Zhang, Z.; Lei, J. Exploration of text matching methods in Chinese disease Q&A systems: A method using ensemble based on BERT and boosted tree models. J. Biomed. Inform. 2021, 115, 103683. [Google Scholar] [CrossRef] [PubMed]
- Luo, S.J.; Dong, Y.N. Role of cultural inspiration with different types in cultural product design activities. Int. J. Technol. Des. Educ. 2017, 27, 499–515. [Google Scholar] [CrossRef]
- Cui, Y.; Che, W.; Liu, T.; Qin, B.; Yang, Z. Pre-training with whole word masking for Chinese BERT. In Proceedings of the IEEE/ACM Transactions on Audio, Speech, and Language Processing, Maynooth, Ireland, 28 July–1 August 2015; IEEE: Piscataway, NJ, USA, 2021. [Google Scholar] [CrossRef]
- GitHub. Available online: https://github.com/ymcui/Chinese-BERT-wwm (accessed on 25 August 2021).
- Liu, Y.; Liu, H.; Wong, L.P.; Lee, L.K.; Zhang, H.; Hao, T. A Hybrid Neural Network RBERT-C Based on Pre-trained RoBERTa and CNN for User Intent Classification. In Proceedings of the International Conference on Neural Computing for Advanced Applications, Shenzhen, China, 27–30 August 2020; Zhang, H., Zhang, Z., Wu, Z., Hao, T., Eds.; Springer: Cham, Switzerland, 2020; pp. 306–319. [Google Scholar] [CrossRef]
- Liao, W.; Zeng, B.; Yin, X.; Wei, P. An improved aspect-category sentiment analysis model for text sentiment analysis based on RoBERTa. Appl. Intell. 2021, 51, 3522–3533. [Google Scholar] [CrossRef]
- Maldonado-Sifuentes, C.E.; Angel, J.; Sidorov, G.; Kolesnikova, O.; Gelbukh, A. Virality Prediction for News Tweets Using RoBERTa. In Proceedings of the Advances in Soft Computing, MICAI, Mexico City, Mexico, 25–30 October 2021; Batyrshin, I., Gelbukh, A., Sidorov, G., Eds.; Springer: Cham, Switzerland, 2021; pp. 88–95. [Google Scholar] [CrossRef]
- Wang, X.; Iwaihara, M. Integrating RoBERTa Fine-Tuning and User Writing Styles for Authorship Attribution of Short Texts. In Proceedings of the Asia-Pacific Web (APWeb) and Web-Age Information Management (WAIM) Joint International Conference on Web and Big Data, Guangzhou, China, 23–25 August 2021; U, L.H., Spaniol, M., Sakurai, Y., Chen, J., Eds.; Springer: Cham, Switzerland, 2021; pp. 413–421. [Google Scholar] [CrossRef]
Product | Creature | Reason |
---|---|---|
sofa | dog | The big dog that is close to people can be lean against, is big and gentle. |
helmet | hippopotamus head | Hippopotamus head is very typical, honest and heavy, with a sense of security. |
car | cheetah, tiger | We can find some brave but fast animals to design cars, such as cheetahs and tigers. |
Product | Creature | Reason |
---|---|---|
airplane | eagle | Eagles often fly in the sky in a soaring posture, which looks more like an airplane in the air. |
desk lamp | turtle | The shape of the tortoise shell is similar to the countertop at the bottom of the lamp. |
Water cup | camel, pelican | The hump of a camel is like a container, and the beak of a pelican is very big like a container. |
Product | Creature | Reason |
---|---|---|
desk lamp | lantern fish | From a functional point of view, first think of animals that can emit light. The lure of the lantern fish is luminous and has a ‘fishing rod’ structure, which is more consistent with a desk lamp. |
speedboat | squid | Squids spray water backward and fast forward. |
humidifier | whale | Humidifier and whale both can spray water. |
Product | Creature | Reason |
---|---|---|
speedboat | dolphin, shark | Speedboats are in the water, I can directly think of aquatic animals like dolphins and sharks. |
airplane | bald eagle, | Bald eagles live in the sky. |
Product | Creature | Reason |
---|---|---|
motorcycle helmet | Snails, conch, pangolin | They all have very hard shell as motorcycle helmet. |
sofa | rats, brown bear, tiger, orangutan, giraffe, kiwi | Sofa has the surface texture, which can imitate the fur and patterns of wild animals, such as brown bears, tigers, orangutans, and giraffes. Kiwi, because it has a special hairy appearance. |
Product | Creature | Reason |
---|---|---|
cactus | toothpick holder | The thorns are pulled out like toothpicks. |
bald eagle | sickle | The outline is similar to the sickle. |
elephant | excavator | The nose is shaped like an excavator. It is huge and heavy, similar to an excavator. |
Product | Creature | Reason |
---|---|---|
polar bear | warm products | Polar bears look very warm and is suitable for designing quilts, scarves and hats. |
bald eagle | high-end tea set | Bald eagle looks majestic and honorable. |
cheetah | motorcycle | Cheetah is agile, fast and energetic. |
Product | Creature | Reason |
---|---|---|
beetle | climbing aid | Beetles can climb on vertical branches or even glass because of the barbs and suckers on their feet. |
bee | drone | Swarm collaboration, similar to drone fleet |
cactus | water reservoir | Cactus born in the desert but can save many water. |
Product | Creature | Reason |
---|---|---|
cheetah | camouflage | The cheetah’s skin has leopard print, which is easy to camouflage on the grassland. |
jellyfish | umbrella | Jellyfish is transparent or transparent with color, it looks like an umbrella. |
polar bear | sofa | Polar bear’s cortex looks advanced. |
Reasoning direction | Product to Biology | Biology to Product |
Output quantity | Biology Avg = 3.09 | Product Avg = 2.66 |
Reasoning mode and frequency | Affective Perception Reasoning (72) Form Reasoning (49) Function Reasoning (34) Environment Reasoning (20) Material Reasoning (19) | Form Reasoning (60) Affective Perception Reasoning (58) Function Reasoning (27) Material Reasoning (26) |
Reasoning direction | Product to Biology | Biology to Product |
Name | Affective Perception | Function | Habitat | Material |
---|---|---|---|---|
giraffe | docile; elegant; beautiful; friendly | fight with the neck as a weapon; sleep in a standing position | grassland, shrubland, albizia woodland | short coat; variegated reticulation |
dolphin | docile; friendly; cute; flexible | echolocation; good at jumping and snorkeling; swimming | ocean | smooth and hairless; sharp legs |
owl | alert; funny; cute | night walking; strong night vision; eyes cannot turn in different directions. | tree; rock; grass; sky | soft feathers |
Name | Affective Perception | Function | Using Environment | Material |
---|---|---|---|---|
tank | large; hidden | reconnaissance; firing artillery; turret can rotate; advance slowly | jungle, grassland, desert | sturdy |
ski board | fashion; cool | reduce the pressure on the gripping area on the snow | snow field | firm; smooth |
hot air balloon | enthusiasm; lively | flying; the inside of the balloon heats the air and uses buoyancy to displace the whole | in the air | fire resistance; good airtightness; bright colors |
Affective Perception | fashion; warm |
Function | illuminate |
Material | light |
Using Environment | in the room |
Inference sentence: fashion | |
Result | (‘fashion’, [Flamingo]), (‘handsome’, [bald eagle, zebra, cheetah]), (‘light’, [jellyfish, butterfly]), (‘elegant’, [giraffe, emperor penguin, cheetah, red-crowned crane, swan, puppet cat]), (‘sexy’, [hippo]) |
Similarity | [1.0000000, 0.7545206, 0.7223246, 0.7198027, 0.7121808] |
Inference sentence: warm | |
Result | (‘warm’, [polar bear, giant panda, sunflower]), (‘homesick’, [emperor penguin]), (‘docile’, [African elephant, giraffe, dolphin, lop-eared rabbit, sheep, pig, puppet cat]), (‘friendly’, [pigeon, golden retriever, puppet cat]), (‘lazy’, [puppet cat]) |
Similarity | [0.8465299, 0.7907890, 0.7823601, 0.7615751, 0.7563425] |
Inference sentence: illuminate | |
Result | (‘glow’, [jellyfish]), (‘strong night vision’, [owl]), (‘phototaxis’, [praying mantis]), (‘active at night’, [bat]), (‘night walk’, [owl, tiger]) |
Similarity | [0.7271294, 0.709383, 0.7041074, 0.6780104, 0.6738881] |
Inference sentence: light | |
Result | (‘light’, [jellyfish]), (‘supple’, [golden retriever]), (‘soft’, [puppet cat]), (‘smooth’, [orca, beetle, ant, bamboo’]), (‘fluffy’, [ostrich]) |
Similarity | [1.0000000, 0.8214510, 0.7871054, 0.7731293, 0.7605499] |
Inference sentence: in the room | |
Result | (‘in the air’, [bee, red-crowned crane]), (‘sky’, [bald eagle, owl, flamingo, woodpecker, pigeon]), (‘on the tree’, [woodpecker]), (‘desert’, [camel, cactus]), (‘ocean’, [jellyfish, killer whale, dolphin]) |
Similarity | [0.7273592, 0.6848752, 0.6745558, 0.6739956, 0.6695887] |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Bian, Z.; Luo, S.; Zheng, F.; Wang, L.; Shan, P. Semantic Reasoning of Product Biologically Inspired Design Based on BERT. Appl. Sci. 2021, 11, 12082. https://doi.org/10.3390/app112412082
Bian Z, Luo S, Zheng F, Wang L, Shan P. Semantic Reasoning of Product Biologically Inspired Design Based on BERT. Applied Sciences. 2021; 11(24):12082. https://doi.org/10.3390/app112412082
Chicago/Turabian StyleBian, Ze, Shijian Luo, Fei Zheng, Liuyu Wang, and Ping Shan. 2021. "Semantic Reasoning of Product Biologically Inspired Design Based on BERT" Applied Sciences 11, no. 24: 12082. https://doi.org/10.3390/app112412082
APA StyleBian, Z., Luo, S., Zheng, F., Wang, L., & Shan, P. (2021). Semantic Reasoning of Product Biologically Inspired Design Based on BERT. Applied Sciences, 11(24), 12082. https://doi.org/10.3390/app112412082