happymini2017

The happy mini team (former demura.net) official web site

News: Happy mini, our human support robot, is the 3rd place in sympathy and 5th place in design rating in the @Home league in RoboCup2016 Leipzig by the research of Eva Jahn as shown in this web site.  Many wonderful robots, such as Pepper, HSR, R1, SocRob, Amigo, Tiago and so on, participated in RoboCup@Home2016.

  • Vision

The happy mini team, our former team name was demura.net, has been participating in the RoboCup@Home league of the RoboCup Japan Open since 2012, and participated in the RoboCup 2015 and 2016 world competition. The team got the 9th and 8th places in the competition, respectively.

The vision of the happy mini team is “Making the World Happy by Making a Kawaii Robot.” “Kawaii” means cute, lovely, or charming. We think that the kawaii robot can solve problems of an aging society in Japan, robots in the RoboCup@Home league should be more kawaii. Happy Mini as shown in Fig.1 is designed in the image of a little child with a lively yellow color. Happy Mini is considered to be the first kawaii designed robot in the RoboCup@Home. The software system was based on ROS, and the state of arts frame works such as Caffe, Darknet, Digits, Hark, Kaldi and so on.

  • Robot

(1) Hardware

We have been developing 2 kinds of human support robots.  One is a childcare robot for children and another is a wheelchair robot for the elderly. To foster the research and development, the Demura Research Laboratory has been participating in RoboCup@Home since 2012 and Tsukuba Challenge since 2008.

The design concepts of  Happy Mini are Kawaii (lovely, cute), simplicity, safety,  and usability.    Kawaii is the most important aspect of human-robot interaction for Mini. Mini is an infant robot, and the ability is limited as well as other robots in RoboCup. So, Mini needs the help of human, that is why kawaii of appearance and voice is crucial for Mini. The exterior of Mini is roundish and lively yellow as shown in Fig.1. The technical information of these robots is described in our team description paper(TDP2017HappyMini-final-0312-2314).

 

 

 

 

 

 

 

Fig.1  Happy Mini (Left: CAD design,  Right: Real robot)

torso

Fig.2   Extendable  Torso

Happy Mini
Height [m] 1.10~1.50
Width [m] 0.32
Length [m] 0.32
Weight [kg] 10.0
Max speed [m/s] 0.7
D.O.F 5

(2) Software

Perception: The software system is based on ROS and Caffe. Several algorithms are used for an object and human face recognition. HaarCascade classifier, Flat Clustering filtering, and Deep Neural Networks (DNNs) are used for face recognition (Fig.3). Nesterov’s accelerated gradient and Convolution DNNs are used for gender classification. We trained the network using 700 samples for each category, and accuracy of classification is about 75 %.

The real-time object detection deep neural newtork, YOLO (You only look once) is used for person detection as shown in Fig.4. The algorithm is very fast compared to other DNNs and robust.

face

Fig.3   Face recognition using HarrCascade and DNN

Fig.4  Person detection

Speech Recognition and Sound Localization: We have developed a speech recognition and a sound source localization system. The speech recognition system uses the Kaldi based gstream server. It is a real-time full-duplex speech recognition server, and
uses a DNN-based model for English trained on the TEDLIUM speech corpus.

The sound source localization system is implemented using the robot auditory library HARK. The HARK easily be programmed by GUI as shown in Fig.5. The system takes multi-channel speech waveform data from the 8ch microphone array, calculates FFT and estimates the sound source direction by the MUSIC method.

Fig.5  HARK

Simulator: We have developed the Happy Mini simulator using the Gazebo robot simulator as shown in Fig.6. To make the 3D Happy Mini model in the simulator, we described the URDF (Universal Robot-ics Description Format) file and imported 3D meshes from the 3D CAD data. MoveIt! is easily applied to the 3D model described by the URDF

simulator

Fig.6  The Happy Mini Simulator using Gazebo

  • Scientific achievements

Picture book reading: In the globalized modern society, the importance of acquiring English from early childhood is recognized. It is considered important to read a picture book in English. However, few Japanese speak English fluently. Thus, we have been developing a picture book reading application for children. We think that is one of the killer applications for a domestic service robot. Fig.7 shows our demonstration of picture book reading in RoboCup2016. We are planning to test the picture book reading application using Happy Mini in a real kindergarten.

Fig.7 Picture book reading demonstration in RoboCup2016

Road unevenness detection: We have been developing a wheelchair robot and a driver assist technology system for the elderly. The conventional wheelchair is difficult to get over small difference (about 30 [mm]) in level, and it sometimes makes a falling accident. To prevent the accident, the capability of detecting the small difference is required.  We have developed two system to solve the problem.

The first system uses the Kinect V2 sensor as shown in Fig.8, and the second system uses the 3D Rolling Lidar developed by demura.net as shown in Fig.9. As far as our knowledge,  it is the most advanced technology to detect small difference in level for a wheelchair size robot.    Developing the small difference level detector for a commercial wheelchair and a mobility scooter for elderly, and applying the technology to a human support robot is our near future work.

kinect_method                 Fig.8  The results of detection of 30 [mm] difference in level by the Kinect V2.

rollingLidar

Fig.9 The results of detection of 25 [mm] difference in level by the Rolling 3D Lidar

  •  Team Description Paper
  • Publications
    • Journal
      • 竹井義則，小暮潔, 河並崇,中沢実, 出村公成：”夢考房ジュニアにおけるロボット技術を活用した教育実践について”,  KIT Progress, No.23, pp.139-148 (2015)
      • 河並崇，竹井義則，中沢実，小暮潔, 出村公成：”夢考房ジュニアにおけるICT教育”, KIT Progress, No.23, pp.127-137 (2015)
      • 出村公成，河並崇，竹井義則，中沢実，小暮潔: “夢考房ジュニアのビジョンと展望”,  KIT Progress, No.23, pp.115-126 (2015)
      • Demura, K., Komoriya Y. “A Navigation Method using the Mutual Feedback of Waypoints and Self-positions,” Advanced Robotics, Vol.26, Issue14, pp.1677-1691 (2012) [Manuscript]
      • Demura, K., Sakamoto, T., Asano, Y. and Matsuishi, M. “Enhancing Student Engineering, Personal, and Interpersonal Skills Through Yumekobo Projects,” Journal of Robotics and Mechatronics, Vol.23, No.5, pp.811-821 (2011)
      • 出村公成，中川祐：“全方位カメラを用いたテンプレートマッチングに基づくモンテカルロ位置同定法”，日本ロボット学会誌，Vol.27，No.2，pp.249-257 (2009)
    • Book
      • 出村公成（分担執筆）：“5編2章 物理エンジン”,　日本ロボット学会編　ロボットテクノロジー，pp.216-219, オーム社　(2011)
      • 出村公成（分担執筆）：“9.2.1節 Open Dynamics Engine”,　松原，松野，稲見，野田，大須賀編著　ロボット情報学ハンドブック，pp.582-592, ナノオプトニクスエナジー　(2010)
    • Conference
      • 出村公成，永島一輝，吉田颯，土田嵩也，木村晨次朗，榎本光洋，岩崎稜, 出村賢聖：“クローラー型パーソナルモビリティUNiMOを用いた自律移動ロボットの開発”，つくばチャレンジ2016参加レポート集，pp10-11 (2016)
      • 浅田駿介、出村公成：“Kinect V2を用いた屋外での小さな障害物検出”, ロボティクス・メカトロニクス講演会2016, 1A1-08a3 (2016)
      • 滝渉， 出村公成:”生活支援ロボットシミュレータとROSの連携”， 第16回計測自動制御学会システムインテグレーション部門講演会　論文集， 3F2-2 (2015)
      • 西川徹，浅田駿介，山森清広，出村公成，河原貴軌：“つくばチャレンジ2015における金沢工業大学demura.netチームの開発”，つくばチャレンジ2015参加レポート集，pp13-15 (2015)
      • 西川徹，出村公成：“低位置障害物検出を目的とした3次元レーザ式測域センサの開発”，第16回計測自動制御学会システムインテグレーション部門講演会，3E3-4 (2015)
      • 西川徹，出村公成：“3次元レーザ式測域センサを用いた障害物検出システムの開発”, ロボティクス・メカトロニクス講演会2014, 3P1-X01 (2014)
      • 菅原 啓， 市野陽太，岡本拓真，西川 徹，山岸卓央，河原貴軌，山崎亮一，出村公成 ：“つくばチャレンジ 2013における 金沢工 大 demura.netチーム の開発”, つくばチャレンジ2013参加レポート集, p.18-19 (2014)
      • 市野陽太，出村公成：“つくばチャレンジ2013におけるロボットリモート監視システムの開発”, 第14回計測自動制御学会システムインテグレーション部門講演会論文集, 1A3-2 (2013)
      • 菅原啓，出村公成：“道路領域検出に基づくウェイポイント推定”, 第14回計測自動制御学会システムインテグレーション部門講演会論文集, 1A1-6 (2013)
      • 竹迫翔平，出村公成：“特徴量マッチングを用いたウェイポイント推定”, 第３０回日本ロボット学会学術講演会, 2F3-6 (2012)
      • 出村公成:“つくばチャレンジの歩みとdemura.netチームの取り組み”, 電子情報通信学会クラウドネットワークロボット研究会, 信学技報告 Vol.112, No.105, CNR2012-2 (2012)
      • 市野陽太，出村公成:“物理計算エンジンODEにCADデータを読込ますプログラムの開発”, ロボティクス・メカトロニクス講演会’12, 2A2-E07 (2012)
      • 出村公成:“ロボカップジュニア理念実現のためのロボットスクール”, 第２９回日本ロボット学会学術講演会, 2C2-2 (2011)
      • 竹迫翔平，出村公成：“ポールスターアルゴリズムの特徴量抽出を拡張した自己位置同定”, ロボティクス・メカトロニクス講演会’11, 2A1-M07 (2011)
      • 出村公成:“物理計算エンジンにおけるOpen Dynamics Engineの位置付け”, 第11回計測自動制御学会システムインテグレーション部門講演会論文集, 1B2-1 (2010)
      • 山澤貴史，出村公成：“自律移動ロボットの動的な走行経路生成”, 第11回計測自動制御学会システムインテグレーション部門講演会論文集, 1A3-5 (2010)
      • 細川和真，出村公成:“動力学エンジンODE用グラフィックスライブラリの開発　-Drawstuff 上位互換ライブラリ-（第5報）, 第２８回日本ロボット学会学術講演会, 3L2-2 (2010)
      • 市川修司，出村公成:“照明変化にロバストなロボットビジョンシステム”, 第２８回日本ロボット学会学術講演会, 3I1-3 (2010)
      • 小林秀成，出村公成:“円検出によるセンターラインの特定を用いた自己位置同定”, 第２８回日本ロボット学会学術講演会, 2Q1-5 (2010)
      • 出村公成：“ロボットの自己位置推定－つくばチャレンジ＆ロボカップの事例から－”，第８回レーザ計測イノベーション勉強会 (2010)
      • 出村公成、細川和真：“動力学計算エンジンODE用グラフィクスライブラリの開発（第４報）-上位互換ライブラリirrDrawStuffのリリース-, ロボティクス・メカトロニクス講演会’10, 1P1-G28 (2010)
      • 出村公成, 山澤貴史, 島野広之, 山内啓右:“電動車椅子をベースとした自立移動ロボットの開発”, つくばチャレンジ2009　開催記念シンポジウム参加レポート集， p.14-16 (2010)
  • Software
  • Team
    • Adviser: Kosei Demura
    • Member:Koyo Enomoto (Leader),  Kazuki Nagashima, Takeaki Yamakawa, Ryo Iwasaki, Syuhei Mashimo, Kensei Demura and Kosei Demura
  • Previous participation in RoboCup@Home
    • RoboCup Japan Open 2012
      • @Home: Real Robot League
    • RoboCup Japan Open 2013
      • @Home: Real Robot League
      • @Home: Simulation League (only in Japan Open)
    • RoboCup Japan Open 2014
      • @Home: Real Robot League
      • @Home: Simulation League (only in Japan Open): 3rd place (Team name: Yumekobo Junior)
    • RoboCup Japan Open 2015
      • @Home: Real Robot League
      • @Home: Simulation League (only in Japan Open)
    • RoboCup 2015, Heifei,  China
      • @Home: 9th place
    • RoboCup Japan Open 2016
      • @Home: 1st place in Education League (only in Japan Open)
      • RoboCup 2016, Leipzig, Germany
        @Home: 8th place
  • Our Sponsors：
  • The  Platinum Sponsor

    株式会社　都筑製作所    都筑製作所ロゴ
  • Gold Sponsors

三光合成ロゴ_フォントサイズ７２

logo_ao

 

 

スポンサーリンク
シェアする
demura.netをフォローする
demu
ホーム
タイトルとURLをコピーしました