高质量发展理论与实践

基于关系视角的竞赛众包创意智能筛选方法

  • 张雪峰 ,
  • 洪勇
展开
  • 安徽工程大学,安徽 芜湖 241000
张雪峰(1987—),男,工学博士,安徽工程大学经济与管理学院教授,研究方向为创新管理、知识管理;
洪勇(2000—),男,安徽工程大学经济与管理学院硕士研究生,研究方向为创新管理、信息系统与管理。

收稿日期: 2025-06-27

  网络出版日期: 2025-11-03

基金资助

安徽省社会科学创新发展研究课题“知识密集型众包参与者行为演化机理与服务优化研究”(2023CX097)

An Intelligent Screening Method for Competition Crowdsourcing Creativity Based on Relationship Perspective

  • ZHANG Xuefeng ,
  • HONG Yong
Expand
  • Anhui Polytechnic University, Wuhu 241000, China

Received date: 2025-06-27

  Online published: 2025-11-03

摘要

对于竞赛众包,如何快速有效地对数量较多的备选创意进行筛选是亟须解决的问题。文章基于创意关系视角,从新颖性和可行性两个方面衡量创意质量,并采取去除低质量创意和保留高质量创意的筛选策略。首先针对以文本形式描述的创意,采用隐含狄利克雷分布主题模型,按照创意之间的差异化程度(新颖性)将创意划分为多个不同的主题;其次采用杰卡德系数计算方法构建每个主题及其所包含的全部创意的语义网络,并转化为对应的累积分布,进而通过Kolmogorov-Smirnov统计量度量网络之间的距离;最后对每个主题中的创意按照可行性的高低(网络距离的大小)进行排序,从而为创意筛选提供依据。进一步地,将此方法用于筛选3个竞赛众包中的创意,结果表明该方法在识别低质量创意中的精确率较高,在识别高质量创意中的召回率较高。相较于常见的基于文本长度、大众评价、SBERT模型的筛选方法,该方法在筛选的精确率和召回率上均表现更好。

本文引用格式

张雪峰 , 洪勇 . 基于关系视角的竞赛众包创意智能筛选方法[J]. 新疆财经, 2025 , 0(5) : 16 -29 . DOI: 10.16716/j.cnki.65-1030/f.2025.05.002

Abstract

In crowdsourcing contests, a big challenge is to screen good ideas from a large number of alternative ideas. To address this challenge, this study develops a relation-based intelligent method for idea screening (Rela-IdeaS). This method adopts the strategies of retaining ideas with high quality and eliminating ideas with low quality based on idea novelty and feasibility. Specifically, this study employed the latent dirichlet allocation method to classify the ideas into various themes based on their novelty. Furthermore, the Jaccard coefficient method was used to construct semantic networks of each idea theme and its included ideas. With the help of cumulative distribution functions, these semantic networks were transformed into cumulative distributions Moreover, we used Kolmogorov-Smirnov statistics to measure the distance between semantic networks of ideas and idea themes. Finally, the ideas in each theme were ranked for further screening based on their values of feasibility (i.e., network distance). We applied our method to screen ideas from three crowdsourcing contests. The results indicated that using the proposed method to screen the ideas with low quality has a good precision rate. For screening the ideas with high quality, the method has a good recall rate. Additionally, compared to the commonly used methods, i.e., methods based on idea text length, crowd voting, and the SBERT model, our method performed better in precision and recall rates.

参考文献

[1] ZHANG X F, HONG Y, SU J F, et al. Examining the need for participation-oriented designs of crowdsourcing plat- forms:a comparison of contributors and potential contributors[J]. IEEE transactions on engineering management, 2024,71:11479-11493.
[2] 张雪峰, 操雅琴, 丁一. 众包模式下基于参与者胜任度和接受度的任务推送模型[J]. 管理科学, 2019(1):66-79.
[3] HU S Y, XU D. Identifying high quality ideas in the online context:evidence from a meta-analysis[J]. European jour- nal of innovation management, 2023(3):707-729.
[4] CHRISTENSEN K, SCHOLDERER J, HERSLETH S A, et al. How good are ideas identified by an automatic idea de- tection system?[J]. Creativity and innovation management, 2018(1):23-31.
[5] ZHU Y, RITTER S M, DIJKSTERHUIS A J. Creativity:intrapersonal and interpersonal selection of creative ideas[J]. The journal of creative behavior, 2020(3):626-635.
[6] LI M G, KANKANHALLI A, KIM S H. Which ideas are more likely to be implemented in online user innovation com- munities? An empirical analysis[J]. Decision support systems, 2016,84:28-40.
[7] RIETZSCHEL E F, NIJSTAD B A, STROEBE W. The selection of creative ideas after individual idea generation: choosing between creativity and impact[J]. British journal of psychology, 2010(1):47-68.
[8] QIN M, LI S Q, CAI F T, et al. Where are your ideas going? Idea adoption in online user innovation communities[J]. European journal of innovation management, 2024(6):2122-2148.
[9] BERETTA M. Idea selection in web-enabled ideation systems[J]. Journal of product innovation management, 2019 (1):5-23.
[10] CHEN L, XU P, LIU D. Effect of crowd voting on participation in crowdsourcing contests[J]. Journal of management information systems, 2020(2):510-535.
[11] BELL J J, PESCHER C, TELLIS G J, et al. Can AI help in ideation? A theory-based model for idea screening in crowdsourcing contests[J]. Marketing science, 2024(1):54-72.
[12] WAHL J, FüLLER J, HUTTER K. AI-assisted searching:through crowdsourced solution space[J]. Marketing review St. Gallen, 2022(6):30-38.
[13] CUI Z J, KUMAR P M S, GON?ALVES D. Scoring vs. ranking:an experimental study of idea evaluation processes[J]. Production and operations management, 2019(1):176-188.
[14] CHOU J-R. An ideation method for generating new product ideas using TRIZ,concept mapping,and fuzzy linguistic evaluation techniques[J]. Advanced engineering informatics, 2014(4):441-454.
[15] LALICIC L, DICKINGER A. Harvesting tourists’ ideas through an idea contest[J]. International journal of contem- porary hospitality management, 2019(11):4380-4400.
[16] JIAN L, YANG S, BA S L, et al. Managing the crowds:the effect of prize guarantees and in-process feedback on par- ticipation in crowdsourcing contests[J]. MIS quarterly, 2019(1):97-112.
[17] ZHANG X, CHEN Q. Towards an understanding of the decision process of solvers’ participation in crowdsourcing contests for problem solving[J]. Behaviour & information technology, 2022(12):2635-2653.
[18] POETZ M K, SCHREIER M. The value of crowdsourcing:can users really compete with professionals in generating new product ideas?[J]. Journal of product innovation management, 2012(2):245-256.
[19] MAGNUSSON P R, W?STLUND E, NETZ J. Exploring users’ appropriateness as a proxy for experts when screening new product/service ideas[J]. Journal of product innovation management, 2016(1):4-18.
[20] JUST J, THOMAS S, JOHANN F, et al. AI-based novelty detection in crowdsourced idea spaces[J]. Innovation, 2023 (3):359-386.
[21] LIU Q, DU Q Z, HONG Y L, et al. User idea implementation in open innovation communities:evidence from a new product development crowdsourcing community[J]. Information systems journal, 2020(5):899-927.
[22] ZHOU L X, ZHANG Z Y, ZHAO L J, et al. How user personality and information characteristics influence the cre-ative information quality on open innovation platforms:an elaboration likelihood model[J]. Kybernetes, 2022(7): 2305-2325.
[23] ZENG Q F, ZHANG L L, GUO Q, et al. Factors influencing user-idea selection in open innovation communities[J]. International journal of electronic commerce, 2022(4):415-440.
[24] HOORNAERT S, BALLINGS M, MALTHOUSE E C, et al. Identifying new product ideas:waiting for the wisdom of the crowd or screening ideas in real time[J]. Journal of product innovation management, 2017(5):580-597.
[25] CHAN K W, LI S Y, ZHU J J. Good to be novel? Understanding how idea feasibility affects idea adoption decision making in crowdsourcing[J]. Journal of interactive marketing, 2018(1):52-68.
[26] LIN J, WANG C, ZHOU L X, et al. Converting consumer-generated content into an innovation resource:a user ideas processing framework in online user innovation communities[J]. Technological forecasting and social change, 2022, 174:121266.
[27] ZHAO D, LI X Y, MA H D. Budget-Feasible online incentive mechanisms for crowdsourcing tasks truthfully[J]. IEEE-ACM transactions on networking, 2016(2):647-661.
[28] SCHEMMANN B, HERRMANN A M, CHAPPIN M M H, et al. Crowdsourcing ideas:involving ordinary users in the ideation phase of new product development[J]. Research policy, 2016(6):1145-1154.
[29] BANKEN V, ILMER Q, SEEBER I, et al. A method for smart idea allocation in crowd-based idea selection[J]. Deci- sion support systems, 2019,124:113072.
[30] DEAN D L, HENDER J M, RODGERS T L, et al. Identifying quality,novel,and creative ideas:constructs and scales for idea evaluation[J]. Journal of the association for information systems, 2006(10):646-698.
[31] KRISTENSSON P, GUSTAFSSON A, ARCHER T. Harnessing the creative potential among users[J]. Journal of pro- duct innovation management, 2004(1):4-14.
[32] TOUBIA O, NETZER O. Idea generation,creativity,and prototypicality[J]. Marketing science, 2017(1):1-20.
[33] CUI Z J, BARABOSHKIN V, GON?ALVES D. Selecting-the-best vs. eliminating-the-worst:an experimental inves- tigation of idea evaluation processes under cognitive bias conditions[J]. IEEE transactions on engineering manage-ment, 2024,71:14775-14788.
[34] ZHANG K, ZHOU Y, CHEN Z, et al. Incorporating biterm correlation knowledge into topic modeling for short texts[J]. Computer journal, 2022(3):537-553.
[35] HEINRICH G. Parameter estimation for text analysis[R]. Technical note,darmstadt, Germany,2009:1-31.
[36] PRINCIPE V A, VALE R G D S, DE CASTRO J B P, et al. A computational literature review of football performance analysis through probabilistic topic modeling[J]. Artificial intelligence review, 2022(2):1351-1371.
[37] RAHMAN Z, HUSSAIN A, SHAH H, et al. Urdu news clustering using K-mean algorithm on the basis of jaccard co- efficient and dice coefficient similarity[J]. Advances in distributed computing and artificial intelligence journal, 2021 (4):381-399.
[38] 方旺盛, 杨庚, 胡中栋. 杰卡德系数差分误差跳距修正的DV-hop改进算法[J]. 计算机工程与应用, 2018(23): 57-63.
[39] 姚晓磊, 鱼京善, 孙文超. 基于累积分布函数匹配的多源遥感土壤水分数据连续融合算法[J]. 农业工程学报, 2019(1):131-137.
[40] 金堃, 于柯远, 凌青, 等. 基于K-S检验的MIMO-STBC盲识别技术[J]. 计算机仿真, 2022(4):124-128+222.
[41] 郑震, 严迎建, 蔡爵嵩, 等. 基于双样本KS检验的非特定TVLA能量泄漏评估方法[J/OL]. 通信学报.https://kns.cnki.net/kcms2/detail/11.2102.TN.20230523.1603.012.html.
文章导航

/