Projects (EN)

Manipulation planning and learning of deformable objects

Tasks involving deformable objects can be observed in various environments such as living spaces, factory settings, and logistics sites, but it is not easy to have automated machines perform these tasks. Our laboratory aims to research and systematize the modeling, recognition, manipulation, and behavioral learning of flexible objects. We are tackling this using various methods, including traditional image processing techniques, motion planning extensions, deep learning, reinforcement learning, and imitation learning.

  • Generation of Cloth Manipulation Procedures Based on Predictions
  • Automatic Acquisition of Folding Tasks
  • Simulations for Deformable Objects
  • Differentiable Simulation

Motion learning and planning for mobile manipulators

This research focuses on the intelligence of robots equipped with robotic arms mounted on mobile platforms (mobile manipulators). Mobile manipulators have both mobility and object manipulation capabilities, allowing for various applications. However, they need to address the redundancy of movement degrees of freedom and the complexity of the surrounding environment. Our laboratory is advancing several studies from the perspectives of vision, motion planning, and behavioral learning.

  • System Integration of Household Support Robots
  • Efficiency of Object Recognition Actions Based on Long-Term Activity Experience
  • Simultaneous Execution of Task Planning and Motion Planning

Action support by autonomous robots

This research focuses on robot systems that support human tasks by staying close to people. The requirement for robots here is not to proceed at their own pace, but to recognize and predict human actions and intentions, and to move appropriately in accordance with the person. Our laboratory is working on supporting daily activities such as dressing and fetching objects. Here are some of our research achievements.

  • Dressing Assistance System for Individuals with Hemiplegia
  • Proposal and Implementation of Branch-Type Robots for Task Support
  • Object Manipulation Skills by Imitating Human Actions

Other research topics include the followings.

Autonomous Behavior Control of Robots Using Fundamental Models

Robots need the ability to autonomously make decisions and act according to the environment and situation. The foundational model is a collection of basic knowledge that supports the robot’s decision-making. By using this, robots are endowed with high flexibility in generating actions, enabling them to efficiently perform complex tasks.

  • Consideration of Dynamic Phenomena in Action Generation for Procedural Tasks
  • Generation of Appropriate Pushing and Avoidance Actions in Obstructed Situations

Task and motion planning for multi-DoF robots

Robots with many degrees of freedom can perform tasks in various postures. However, it becomes necessary to carefully consider which posture to adopt. Therefore, we have proposed evaluation criteria and methods for selecting appropriate postures, as well as motion generation methods that leverage the high degrees of freedom.

  • Grasp Planning Using Automatically Generated Object Models
  • Grasp Posture Planning Considering Possible Errors
  • Obstacle Avoidance Method Using Virtual Arms

Vision system for field robots

This research theme aims to contribute to the automation of outdoor tasks, which are facing labor shortages. Our laboratory has been advancing research on recognition functions to assist with search operations, inspection tasks, and the harvesting of agricultural products.

  • Image Recognition System to Support Search and Situation Confirmation Activities
  • Detection of Harvested Produce for Automatic Harvesting Machines of Head-Type Vegetables
  • Navigation Algorithm for Autonomous Mobile Robots

Hardware fabrication suitable for object manipulation in the manufacturing process

In the context of automating product manufacturing, we are exploring new robot hands and sensors that are not bound by conventional thinking.

  • End Effector for Fabric Winding
  • End Effector for Cable Wiring
  • Pair of End Effectors to Facilitate Fabric Unfolding Tasks

Using robotics in human work measurement

We are conducting research to analyze human work capabilities and apply them to robots, or to elucidate human work capabilities using robotics technology.

  • Measurement of Finger Movements and Force Information During Sewing Tasks
  • Construction of Measurement Systems for Wall Painting Tasks and Analysis of Skilled Workers’ Abilities
  • Estimation of Walking Movements of People Moving Over Wide Areas