Qing Da (Q. Da) 中文简历
csdaqing@gmail.com / linkedin / Google scholar / DBLP
I received my B.Sc. degree and M.Sc. degree from Nanjing University, China in 2010 and 2013 respectively. Since Sep. 2013, I become a Ph.D. student in the LAMDA Group, Nanjing University, under the supervision of Prof. Zhi-Hua Zhou.
In Jan. 2015 (my 2nd Ph.D. year), I quit the Ph.D. program and joined the search algorithm team at Alibaba. Now I am a Senior Staff Algorithm Engineer of Alibaba Group.
Research Interests
My research interests include machine learning, data mining and their applications in search, recommendations and advertisement.
Career
- Jan 2015 – Jun 2016: Algorithm Engineer II (资深算法工程师), Search Department, Alibaba Group
- Jul 2016 – Dec 2017: Senior Algorithm Engineer (算法专家), Search Department, Alibaba Group
- Jan 2018 – Jul 2020: Staff Algorithm Engineer (高级算法专家), AI International Department, Alibaba Group
- Aug 2020 – Present: Senior Staff Algorithm Engineer (资深算法专家), AE Tech Department, Alibaba Group.
Books
- Qing Da, An-Xiang Zeng, Reinforcement Learning Beyond Games: To Make a difference in Alibaba. Electronic Industry Press, 2018. Link
Environments
1. VirtualTaobao[AAAI’19], Github.
This project provides VirtualTaobao simulators trained from the real-data of Taobao, one of the largest online retail platforms. In Taobao, when a customer entered some query, the recommondation system returns a list of items according to the query and the customer profile. The system is expected to return a good list such that customers will have high chances of clicking the items.
Using VirtualTaobao simulator, one can access a “live” environment just like the real Taobao environment. Virtual customers will be generated once at a time, the virtual customer starts a query, and the recommendation system needs to return a list of items. The virtual customer will decide if it would like to click the items in the list, similar to a real customer.
How VirtualTaobao was trained is described in：
- Jing-Cheng Shi, Yang Yu, Qing Da, Shi-Yong Chen, An-Xiang Zeng. Virtual-Taobao: Virtualizing real-world online retail environment for reinforcement learning. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI’19), Honolulu, HI, 2019. PDF
2. SESim, Github.
SESim is an E-Commerce search engine simulation platform for model examinations, which was a missing piece to connect evaluations of LTR researches and business objectives of real-world applications. SESim can examine models in the simulation E-commerce environment with dynamic responses, and its framework can be easily extended to other scenarios that items and users have differ- ent features. We hope to see the development of a dynamic dataset that facilitates industrial LTR researches in the future.
A typical process of industrial search engines contains three stages to produce a display list from a user query. A search engine first retrieves related items with intend of the user (i.e. the user query), then the ranker ranks these items by a fine-tuned deep LTR model, finally, the re-ranker rearranges the order of items to achieve some businesses goals such as diversity and advertising. Our proposed simulation platform SESim contains these three stages. We replace queries with category indices in our work, therefore SESim can retrieve items from a desensitized items database by the category index. After that, a customizable ranker and a customizable re-ranker produce the final item list. SESim allows us to study joint learning of multiple models, we left it as future work and focus on the correct evaluation for a single model.
Besides the set of real items, two important modules make SESim vividly reflect the behaviors of real users. Virtual user module aims at generating embeddings of virtual users and their query, and it follows the paradigm of Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP). Feedback module inputs the dis- play list and the information of the user, then outputs the feedback of users on the display list. To model the decision process of users, we train the feedback module by Generative Adversarial Imitation Learning (GAIL). For diversifying behaviors, we consider clicking and purchasing, which are two of the most important feedback of users in E-commerce.
How SESim was trained is described in：
- Yongqing Gao, Guangda Huzhang, Weijie Shen, Yawen Liu, Wen-Ji Zhou, Qing Da, Yang Yu. Imitate The World: A Search Engine Simulation Platform. Submitted to CIKM’21, CORR abs/2107.07693.
Publications
- Wen-Ji Zhou, Yunan Ye, Qing Da, Yinfu Feng, Anxiang Zeng, Han Yu and Chunyan Miao. Policy Gradient Matching for Recommendation Systems. Submitted to CIKM’21.
- Chenlin Shen, Guangda Huzhang, Yu-Hang Zhou, Shen Liang, Qing Da. A General Traffic Shaping Protocol in E-Commerce. Submitted to CIKM’21.
- Xuesi Wang, Guangda Huzhang, Qianying Lin, Qing Da. Learning-To-Ensemble by Contextual Rank Aggregation in E-Commerce. Submitted to CIKM’21.
- Yongqing Gao, Guangda Huzhang, Weijie Shen, Yawen Liu, Wen-Ji Zhou, Qing Da, Yang Yu. Imitate The World: A Search Engine Simulation Platform. Submitted to CIKM’21, CORR abs/2107.07693.
- Wenya Zhu, Yinghua Zhang, Yu Zhang, Yu-Hang Zhou, Yinfu Feng, Qing Da, Yuxiang Wu and Xiaoyu Lv. DHA: Product Title Generation with Discriminative Hierarchical Attention for E-commerce. Submitted to CIKM’21.
- Wenya Zhu, Xiaoyu Lv, Baosong Yang, Yinghua Zhang, xu yong, Dayiheng Liu, Linlong Xu, yinfu feng, Haibo Zhang,Qing Da and Weihua Luo. CLPR-9M: An E-Commerce Dataset for Cross-Lingual Product Retrieval. Submitted to EMNLP’21.
- Junmei Hao, Jingcheng Shi, Qing Da, Anxiang Zeng, Yujie Dun, Xueming Qian, Qianying Lin. Diversity Regularized Interests Modeling for Recommender Systems. Submitted to TMM. CORR abs/2103.12404
- Yanshi Wang, Jie Zhang, Qing Da, Anxiang Zeng. Delayed Feedback Modeling for the Entire Space Conversion Rate Prediction, 2020, CORR abs/2011.11826
- Guangda Huzhang, Zhen-Jia Pang, Yongqing Gao, Yawen Liu, Weijie Shen, Wen-Ji Zhou, Qianying Lin, Qing Da, An-Xiang Zeng, Han Yu, Yang Yu, Zhi-Hua Zhou. AliExpress Learning-To-Rank: Maximizing Online Model Performance without Going Online. IEEE Transactions on Knowledge and Data Engineering (TKDE). CORR abs/2003.11941
- Yu-Hang Zhou, Peng Hu, Chen Liang, Huan Xu, Guangda Huzhang, Yinfu Feng, Qing Da, XInshang Wang, An-Xiang Zeng. A Primal-Dual Online Algorithm for Online Matching Problem in Dynamic Environments. In: Proceedings of the 34rd AAAI Conference on Artificial Intelligence (AAAI-21). PDF
- Anxiang Zeng, Han Yu, Qing Da, Yusen Zhan, Chun-yanMiao, Accelerating E-Commerce Search Engine Ranking by Contextual Factor Selection. In: Proceedings of the 34rd AAAI Conference on Artificial Intelligence (AAAI-20 / IAAI-20), New York, USA, 2020. PDF
- Pengcheng Li, Runze Li, Qing Da, An-Xiang Zeng, Lijun Zhang. Improving Multi-Scenario Learning to Rank in E-commerce by Exploiting Task Relationships in the Label Space. In: Proceedings of the 29th International Conference on Information and Knowledge Management (CIKM’20), Virtual Event, Ireland, 2020. PDF
- Jing-Cheng Shi, Yang Yu, Qing Da, Shi-Yong Chen, An-Xiang Zeng. Virtual-Taobao: Virtualizing real-world online retail environment for reinforcement learning. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI’19), Honolulu, HI, 2019. PDF
- Feiyang Pan, Qingpeng Cai , An-Xiang Zeng , Chun-Xiang Pan, Qing Da, Hualin He, Qing He, Pingzhong Tang. Policy Optimization with Model-based Explorations. In: Proceedings of the 33rd AAAI Conference on Artificial Intelligence (AAAI’19), Honolulu, HI, 2019. PDF
- Hua-Lin Hei, Chun-Xiang Pan, Qing Da, An-Xiang Zeng. Speeding up the Metabolism in E-commerce by Reinforcement Mechanism Design. In: “Proceedings of the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD’18)“, Dublin, Ireland, 2018. PDF
- Shi-Yong Chen, Yang Yu, Qing Da, Jun Tan, Hai-Kuan Huang and Hai-Hong Tang. Stablizing reinforcement learning in dynamic environment with application to online recommendation. In: Proceedings of the 24th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD’18) (Research Track), London, UK, 2018. PDF
- Yujing Hu, Qing Da, Anxiang Zeng, Yang Yu, Yinghui Xu, Reinforcement Learning to Rank in E-Commerce Search Engine: Formalization, Analysis, and Application. In: Proceedings of the 24th ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD’18) (Applied Track), London, UK, 2018. PDF
- Yang Yu, Shi-Yong Chen, Qing Da, Zhi-Hua Zhou. Reusable reinforcement learning via shallow trails. IEEE Transactions on Neural Networks and Learning Systems, 2018, 29(6): 2204-2215. PDF
- Yang Yu, Peng-Fei Hou, Qing Da, and Yu Qian. Boosting nonparametric policies. In: Proceedings of the 2016 International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS’16), Singapore, 2016, pp.477-484. PDF
- Yang Yu and Qing Da, PolicyBoost: Functional policy gradient with ranking-based reward objective. In: Proceedings of AAAI Workshop on AI and Robotics (AIRob’14), Quebec City, Canada, 2014. PDF
- Qing Da, Yang Yu, and Zhi-Hua Zhou. Learning with Augmented Class by Exploiting Unlabeled Data. In: Proceedings of the 28th AAAI Conference on Artificial Intelligence (AAAI’14), Québec city, Canada, 2014. PDF
- Qing Da, Yang Yu, and Zhi-Hua Zhou. Napping for Functional Representation of Policy. In: Proceedings of the 2014 International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS’14), Paris, France, 2014. PDF
- Qing Da, Yang Yu, and Zhi-Hua Zhou. Self-Practice Imitation Learning from Weak Policy. In: Proceedings of the 2nd IAPR International Workshop on Partially Supervised Learning (PSL’13), Nanjing, China, 2013, pp.9-20. PDF
Teaching Assistant
- Data Mining (for M.Sc. students), Fall, 2014
- Data Mining (for M.Sc. students), Fall, 2013
- Digital Image Processing (for undergraduate student), Spring, 2013
Awards & Honors
- OpenAI Retro Contest (Transfer Learning in Reinforcement learning), Champion, 2018
- National Graduate Scholarship, 2012
- First prize of Internet contest for Cloud & Mobile computing (for image search track), 2012
- Grand Prize Winner of the PAKDD 2012 Data Mining Competition (Open Category) (with Nan Li, Chao Qian, Shao-Yuan Li, Yue Zhu, and Zhi-Hua Zhou), 2012
- Outstanding project (six in total over the nation) of China Innovation Program for Students (sponsored by Sun), 2010 (project page)
- Computer World Scholarship, 2009
- First prize in China Undergraduate Mathematical Contest in Modeling (CUMCM), 2008, pdf.
NYC Escorts specializes in exotic Asian relationships and is the largest provider of Asian an escort service. If you choose a partner with whom to go out this service is guaranteed to bring an enjoyable ending. A majority of customers who come into NYC Escorts are looking for long term relationship and marriage. NYC Escorts is the perfect location to search for an exotic date.
Due to the growing Asian number in USA it has led to an increase in demand for exotic Asian women as companions. The majority of Asian women living in the USA are alone and are looking for their life partner of preference. Most of these women do not have the ability to find the perfect partner and search for a new partner to live their lives. As most single women from across the globe want to meet Mr. or Mrs. They are right and cannot seem to find a special man, so they choose to be with an Asian woman.
There are numerous service providers that operate in New York City and most of them are highly in the market. There are several agencies and classified ads online for NYC chauffeurs. The majority of them are advertised in the national press, however it is necessary to look hard for one that is located in the city you live in. Asian girls prefer dating Asian ladies via the phone, and do not want to reveal their real identities. They use fake identities in order to be able to find Mr. and Mrs. They are right.
A man cannot know the identity of a woman, and it becomes very difficult to do so. You can use white girls to date, but in the same way, you have to be extremely cautious about the way you approach them to ensure that you don’t make any wrong decisions. This is why it’s crucial to choose an authentic nyc escorts agency and not with just any agency. You will find agencies which specialize in selecting the best Asian models. You must select one to make your connection to her unique.
If you have reached an agreement on the agency you want to work with, it is time to take a look at the qualities of the females. Some agencies may possibly have you pay an extra amount as they employ a higher than average employee. Make sure that the NYC escorts are carrying a valid visa and will be able to leave the country legally. You may be asked to go to the office to confirm the validity of this. There are also several branches offering International telephone answering and airport service.
Look beyond the cheapest New York City taxicab and think about what these escorts could do. Make sure that the woman you’ve chosen is a legal State resident, however you should make sure that she is not over 18 years of age as this can prevent the possibility of working. The visa she is required to obtain is extremely important and it is a must to never go for any agency that does not provide this absolutely crucial document. Do you know about the background of the girl that you’re thinking about is she a good fit? Do they have enough knowledge to make your firm succeed? She should be capable of revealing a variety of important information to you , such as the story behind her relationship and whether she is an individual who can be really trusted.
NYC Escorts are known in their originality and finding beautiful women on the streets of New York. Though most escort service providers work for tips and may not be able to provide beautiful clients whenever you make a call, there are some who have the ability to establish a connection with each customer at a personal level. This helps to build a strong bond with each customer. It is also important to look at the processes used by the firm you’re going to select. It is not necessary to pay hefty commissions if they are credible. It is crucial to know that they should be a registered business entity and have been in New York for a while.
An online search can help you in finding an established and trustworthy firm that is reputable in New York and you can request a no-cost test of their products, so that you know what to expect from the firm. After you’ve selected the business you want to hire, you can call them on the internet and let them know what you want, they should be able to meet all your needs in the utmost professional manner. If you’re in search of the most reliable NYC party escorts, you should take a look at these suggestions. You shouldn’t choose cheap services as they could not be able to pick your girls escorts nyc up. Remember that having a high-quality service makes all the difference.
”
VIP Escorts New York Attractions for the Newly Dating
In the case of meeting sexually attractive New York City escorts, there are two main ways that can help you locate quality sexually attractive New York City escorts. There is one, which was the traditional method to use your local women’s clubs to find the right sexually appealing New York City escorts. This was a great method at times, but is now quite difficult due to all the online dating websites that have popped up over the past few years. The majority of these online New York dating services are absolutely free, and there’s no reason to not to try them out if you wish. Are you hesitant to be part of the no-cost online dating platform? Many clients choose to find professional New York City escorts through the web as the best choice. Many of the leading adult sites have dozens of local sexually attractive New York escorts available for the pleasure of browsing. It is the most important thing to find the most sexy and elite New York escorts, when looking for top quality, real NY escorts , is to find the GFE (guaranteed extraordinary experience) that you are looking for. There is no doubt that it is no secret that the Big Apple is a hot spot for people seeking the highest level of excitement, sensuality, and sexual diversification in their relationship. There are many people looking for nyc-based sexual escorts. The best option is to check your area to find a VIP escort or NYC coordinator. It is likely that you’ve already met at least one New York-based sexy or escort. They will happily satisfy all your romantic needs for an unforgettable evening of romantic love and romance. You can use one of the numerous online services which will assist you in searching for the perfect nyc VIP escort. Perhaps you’re more comfortable with dinner dates than VIP chauffeurs. It’s important that you pick a person for dinner who’s beautiful and reliable. An ideal dinner date could involve going to a classy NYC restaurant , where you will be able to have a romantic night and stunning escorts which you just can’t stop talking about later! Numerous clients decide to go on dates with an escort with a local VIP to get a memorable and unforgettable”VIP” experience for their girl. Numerous popular sites for dating cater to those looking for local VIP escorts. They’re known for making each client’s wish to come true. They provide their clients with amazing dates that will make their guests speechless. They’re well-known for their creativity, enthusiasm and amazing abilities. Many of the “VIP” Escorts are employed by famous people such as Miley Cyrus, Mariah Carey, Brittney Spears, and many others to ensure your special occasions are flawless. It’s no surprise that they are among the most sought-after escorts within New York City. You may be seeking a memorable romantic date night or an unforgettable and glamorous evening of dancing with your loved one A VIP escort offered by a reputable NYC model club might be what you’re looking for. If you’ve never had the pleasure of using an escort for VIPs prior to, it’s best to use one until you are confident in their methods of operation, staten island escorts and how they treat their customers. You’ll feel more secure in your choice of someone who can make your unforgettable memories memorable and unique.