Job Board

CVPR 2020 is over. Posting jobs is not allowed anymore.


Applied Research Scientist

The Computer Vision Division in Microsoft Cloud and AI is looking for Applied Research Scientists in Computer Vision and Machine Learning.

Qualifications

PhD in Computer Vision, Deep Learning, Machine Learning, or a related field.
Publications in top conferences and journals (CVPR, ECCV, ICCV, NIPS, ICML, IJCV, PAMI, etc.).

Preferred skills:

Strong algorithmic problem solving and software development skills in C/C++.
Proficiency with deep learning frameworks such as PyTorch and Tensorflow.
Research background in the field of object detection, tracking, human pose estimation, activity recognition and 3D computer vision.

To apply, please email your CV with a complete list of publications to Hao Jiang (jiang.hao@microsoft.com).

More info | Contact: Hao Jiang | Posted on: 2020-03-15

Postdoctoral Researchers in Computer Vision, Machine Learning, and Their Applications

Institute for Datability Science, Osaka University was recently established in 2016, and we are now reinforcing our group with highly motivated postdoctoral researchers in: computer vision and pattern recognition, visualization, combined with machine learning, artificial intelligence and machine learning, and natural language processing.

Candidates must (or are expected to) have a PhD in computer science or related fields at the time of appointment and be capable of doing their own research projects from scratch. Upon appointment, candidates are expected to work on their own projects (including budget proposals) in collaboration with other researchers in our group.

Meanwhile, our institutional mission is to provide data science technologies to other disciplinaries; therefore, candidates’ main responsibility is to work on inter-disciplinary projects upon assignment, and they are expected to work on them at the first priority. We have been working on exciting projects with other departments on:

(1) Medical imaging with machine/deep learning, including vessel segmentation/classification in retinal images, surgery video analysis, etc., (2) AI-supported historical document analysis, (3) historical analysis of Buddha faces in 2D and 3D with AI, (4) reflectance analysis of tooth and human tissues for dental and medical applications, and (5) human action recognition for medical and behavior analysis.

More info | Contact: Hajime Nagahara | Posted on: 2020-03-11

Research Software Engineer

We are passionate about discovery, so we’re looking for engineers who want to learn and deploy inventions that could help make better “adventures on foot, with others.” Niantic Engineering leads the advancement of AR and other immersive technologies, while crafting engaging apps for millions of users.

Submit applications by 18 March 2020 for priority consideration.

Responsibilities
You will collaborate with diverse teams of scientists and engineers to build advanced software systems.
You will design minimum viable products using cutting edge and sometimes brittle computer vision and machine learning algorithms.
You will help advance R&D by finding problems, implementing elegant solutions, and building tools that enable the team to move forward and to measure progress.

Qualifications
Significant proven experience working as a Software Engineer in a research lab or in industry.
Excellent practical software engineering ability, particularly Python (profiling/optimization) and C/C++.
Hands-on experience building efficient data pipelines for large-scale processing, and great knowledge on relevant data structures and algorithms.
Experience implementing and advocating for software engineering best practices, including automated testing, containerisation, workflow automation, VCS, continuous integration (CI).
Ability to work with researchers, to translate deep learning research needs into software requirements, and to iteratively develop tools for researchers.
Demonstrated ability to scope and build minimum viable products (MVP).
Demonstrated ability to architect flexible and extensible software systems.
Inquisitiveness to learn about new problems and ideas.
Experience of working collaboratively and presenting and sharing ideas.

Plus if...
Significant experience with GPGPU programming for desktop and mobile (e.g. CUDA, OpenCL, Metal, Vulkan, OpenGL).
Hands-on experience and demonstrated interest in practical and theoretical elements of deep learning.
Experience designing for and running deep learning training systems (e.g. TensorFlow, Pytorch) at scale, including multi-server and multi-GPU training.
Experience managing deep learning hardware resources (GPUs).
Practical experience working with 3D geometry.
Unix and shell scripting expertise.
Experience with database systems and other data storage systems.
Experience with image processing and working with image data.
Experience creating visualisation tools.
Experience with cloud computing and automation tools.
Familiarity with large system software design and development.

More info | Contact: Georgia Ind | Posted on: 2020-03-11

Numerical Optimization Researcher

We truly believe that the company performs at its best when our employees are encouraged to work on what they enjoy. Our team culture means we’re focussed on sharing knowledge between all of our engineers which is why we hold a lot of great technical talks on a weekly basis.

We are passionate about discovery, so we’re looking for scientists who want to learn, publish, and deploy every new invention that could help make better “adventures on foot, with others.”

Responsibilities
Develop flexible non-linear least squares solvers for addressing the company’s vision problems.
Design and deploy solvers to perform bundle adjustment in the context of large-scale structure from motion.
Collaborate with team members in Mapping, R&D, and beyond, to build, test, and improve software systems based on empirical evidence.
Keep abreast of emerging best-practices in mathematical programming and optimization theory, and communicate these to others.

Qualifications
You have a PhD or PhD-level qualifications in either Mathematics, Physics, Electrical Engineering, or Computer Science.
You have demonstrable experience developing and deploying custom solvers for large- scale constrained optimization problems.
You have hands on programming experience with python, numpy and scipy.
You have training in mathematical/numerical optimization, matrix calculus, advanced linear algebra, functional analysis, numerical analysis and approximation theory.
You have experience with designing and developing iterative solvers for parallelizable computational resources.

Plus If...
You have experience developing and deploying custom solvers for optimization of non- linear (robust) least squares problems with sparse Jacobians.
You have experience developing inexact Levenberg-Marquardt solvers for large sparse non-linear least squares problems (see Wright and Holt, Australian Mathematical Society 1985).
You have programming experience with C++, CUDA, cuBLAS, Ceres.
You have programming experience with cupy.
You’re familiar/have experience with SLAM systems or large-scale bundle adjustment problems in structure-from-motion setting.
You have recent publications on mathematical optimization in mathematical optimization venues such as Journal Optimization, Journal of Optimization Theory and Applications, Optimization Letters, Optimization and Engineering, Optimization Methods and Software, Mathematical Programming, Mathematical Programming Computation, Journal on Scientific Computing, etc.
You have publications on structure-from-motion, bundle adjustment or SLAM in computer vision venues such as CVPR, ECCV, ICCV, IJCV, WACV, PAMI, etc.
You are familiar with rotation-averaging approaches for large-scale structure-from-motion problems.
You have coded contributions to Google’s Ceres Solver or similar open-source solvers.

More info | Contact: Georgia Ind | Posted on: 2020-03-10

AR Software Engineer

Niantic’s R&D Team is seeking an ambitious Augmented Reality Software Engineer to push the frontiers of Computer Vision and Machine Learning.

In this role you’ll be part of a collaborative, motivating, and engaging team, to help algorithms evolve from concept to desktop to mobile.

We are all passionate about discovery, so we’re looking for engineers who want to learn and deploy inventions that could help make better “adventures on foot, with others.”

Niantic Engineering leads the advancement of AR and other immersive technologies, while crafting engaging apps for millions of users.

Submit applications by 2nd April 2019 for priority consideration.

Responsibilities-
• Collaborate cross functionally with complementary teams of engineers and designers, to build advanced software for in-field use that will deliver outstanding virtual reality experiences.
• Design systems that enhance the Niantic AR Development Kit and products directly, or through internal R&D tools, to emphasize computer vision and machine learning algorithms.
• Innovate by finding problems, implementing elegant solutions, and building first-of-its-kind technology.
• Write high performance code, debug complex problems that span systems, prioritize tasks effectively and efficiently to meet agreed timelines.
• Learn with us as a team, adopt a problem solving and solutions driven mentality, in order to help educate others, and make a big impact in ambiguous areas of R&D with unfamiliar technologies.

Qualifications
• Demonstrable experience in software development, including shipping one or more products using standard software development practices.
• Passion for code quality and performance.
• Advanced knowledge of C/C++ and C# programming languages.
• Experience developing applications for iOS or Android platforms.
• Strong understanding of programming paradigms and design patterns.
• Confidence in concurrent computing concepts.
• Experience using Metal/OpenGL/Vulkan or other 3D graphics development frameworks.
• Experience crafting Unity APIs and tools.
• Consistent record of working collaboratively in a multi-functional team. Plus If...
• You may have worked with ARKit/ARCore augmented reality frameworks.
• Experience working with CoreML, Vision, TF Lite, Android NNAPI, and other ML frameworks for mobile platforms.
• Experience using tools and frameworks for training machine learning algorithms.
• First-hand experience building computer vision/graphics systems and working knowledge of 3D geometry and linear algebra.
• Communicating technical ideas to experts and non-experts and working with machine learning research teams. Join the Niantic team!

More info | Contact: Georgia Ind | Posted on: 2020-03-10

Ph.D. in the area of Computer Vision and Deep Learning applied to DeepFake Detection

Position is offered within 3iA Côte d’Azur - the Interdisciplinary Institute for Artificial Intelligence (http://univ-cotedazur.fr/institutes/3IA/apply/presentation/phd-position…)
and is ideally located in the heart of the French Riviera, inside the multi-cultural silicon valley of Europe.

Full announcement: http://antitza.com/DFD.pdf

To apply, please email a full application (Cover letter, CV and the names of 2 referees) to Antitza Dantcheva (antitza.dantcheva@inria.fr), indicating [3iA PhD] in the e-mail subject line.

More info | Contact: Antitza Dantcheva | Posted on: 2020-03-10

Post-doc position within AI4GEO research program 24 months

As part of the AI4GEO project ( http://ai4geo.io ), industrial and institutional partners have converged on the creation of products on a global scale valuing 2D and 3D spatial data, namely:
• Time series of land cover maps on a large scale and at very high resolution using jointly radiometric and altimetric information.
• Creation of time series of LOD1 and LOD2 models in order to monitor urban development.
• Creation of semantic 3D models calculated from a mesh of classified 3D point clouds (stereo and lidar)
• Detection and characterization of changes in series of 3D point clouds (stereo and lidar) for applications related to autonomous navigation and monitoring of railway tracks.

In this context, several axes of research have been identified which can lead to work with a strong scientific impact:

• Denoising of Digital Surface Models: Digital surface models and point clouds at the output of the photogrametric restitution chain from multi-view satellite images are often very noisy and this noise has an impact on the prediction quality of subsequent models (machine learning and deep learning). This line of research will consist in studying 2.5D or 3D denoising methods. Several solutions are possible: AI and statistical approaches.

• Multi-scale 3D classification: OBIA 2.5D and 3D classification on several semantic scales using contextual information (spatial and temporal). Today, producing an object classification map is largely feasible, but using the spatial arrangement of these objects among themselves to deduce meta-objects (set of objects having semantic meaning, for example a group of houses aligned with swimming pools and gardens is a housing development) is a real challenge. In addition, the use of "true 3D" models (with associated texture) will improve the performance of semantic classification.

• 3D change detection: Change detection in 3D point cloud time series. This line of research is already the subject of a thesis with the IRISA laboratory. However, we already anticipate that it will be difficult to characterize this change (because we notably lack associated ground truths) and to carry out a scaling up of these methods. The objective of the study will be to be in strong synergy with the doctoral student and to increase the maturity of the methodologies proposed (scaling up and qualification of the results).

• Fusion and registration of point clouds at different scales (terrestrial / airborne LIDAR / satellite data).

• Qualification of AI models: Today, to measure the confidence associated with a predictive model (machine learning and deep learning), the classic method remains to divide a set of data of which we have field truths into 2 subsets: learning and test. Metrics such as F1 score, accuracy, Recall, ROC, IOU are evaluated on the test subset. However, when these models are deployed in the operational phase, they predict each new observation and necessarily give a label to it. The idea is therefore to explore approaches making it possible to identify if the new observation is the result of an implementation of a distribution law similar to that which generated the learning data. New methods, such as probabilistic deep neural network approaches, appear in particular for predictive models embedded in critical environments.

• Correction of learning biases: Finally, an axis of research that is also very important and of evaluating and correcting the bias / noise introduced by either human errors or from sensor measurements in reference data (field truths). Indeed, the presence of this noisy data often leads to a loss of generalization of IA models because these then become very sensitive to minor disturbances on the characteristics of new observations which can therefore induce a poor classification.

The post-doc will be conducted at CNES in Toulouse, France as part of the AI4GEO project. It will be supervised by the host research laboratory.

The recruited person will be integrated into the AI4GEO team and will be able to interact with various departments within CNES, ONERA and IGN. He/She will also be in contact with the ANITI research teams.

2. Profile
The candidate must have a PhD in computer science / signal processing / applied mathematics and be interested in the fields and techniques of Machine Learning / Deep Learning, Computer Vision or Remote Sensing.

To apply, send ASAP cover letter, CV & publications list: pierre.lassalle@cnes.fr, pierre-marie.brunet@cnes.fr & simon.baillarin@cnes.fr

More info | Contact: Simon Baillarin | Posted on: 2020-03-10

Open PhD Position in Computer Vision/Deep Learning for Healthcare

The operating room is a high-tech environment in which the surgical devices generate a lot of data about the underlying surgical activities. Our research group aims at making use of this large amount of multi-modal data coming from both cameras and surgical devices to develop an artificial intelligence system that can assist clinicians and staff in the surgical workflow.

In this context, we currently have a new PhD position at the University of Strasbourg that will focus on developing machine learning and computer vision methods to understand the scene of the operating room, recognize the human activities, and analyze the workflow. The project will use as input multi-view RGB-D videos capturing surgical activities.

As this PhD position is funded by a fellowship from Intuitive Surgical, the successful candidate will have the opportunity to interact with researchers from Intuitive Surgical and also to conduct internships at the company in Sunnyvale, California.

More info | Contact: Nicolas Padoy | Posted on: 2020-03-10

Software Engineer, Computer Vision and AI

The Role

As a software engineer on the Autopilot Computer Vision and AI team, you will contribute to one of the most advanced and widely-deployed computer vision stacks in the world. Along with top researchers from academia and some of the most experienced autonomous vehicle engineers in the industry, you will marry cutting-edge deep learning algorithms with robust, real-time software, and deliver safety-critical features to hundreds of thousands of customers. You will develop and support a host of different projects, driven first-and-foremost by our mission to deploy the safest and most effective product in the market.

Responsibilities

Develop real-time, embedded C++ software to decode, interpret, and assemble the raw neural network outputs into a form consumable by the planning and control stack.
You will build and employ a variety of tools for visualizing, debugging, and validating various layers in the vision pipeline.
You will compose algorithms, primarily in Python, to process massive amounts of fleet data for offline processing.
You will work closely with clients of the vision stack to ensure API’s are sufficient, signal quality and gaps are well-understood, and future needs are being anticipated.

Requirements

MS or PhD in Computer Science, Physics, Electrical Engineering or proof of exceptional skills in related fields, with practical software engineering experience.
Minimum 3 years of experience writing production-level C/C++; experience with C++11 (and later), real-time systems, and generic programming are highly desirable.
Mathematical fundamentals, including: linear algebra, vector calculus, probability, and statistics. Experience implementing this math effectively in software (eg MATLAB, Python, numpy, C++/Eigen, etc.).
Familiarity with core problems in robotics, including state estimation (Kalman filter, particle filter, etc.), SLAM, and signal processing (LTI filtering, outlier rejection, reasoning in both time and frequency domains).
Familiarity with basic computer vision concepts, including: intrinsic and extrinsic calibrations, homogeneous coordinates, projection matrices, and epipolar geometry. Some additional expertise in more advanced geometric fields, such as 3D reconstruction, structure from motion, visual odometry, etc., is highly desirable.
Experience working in a Linux environment.
Basic Git knowledge: creating and merging branches, cherry-picking commits, examining the diff between two hashes. More advanced Git usage is a plus, particularly: development on feature-specific branches, squashing and rebasing commits, and breaking large changes into small, easily-digestible diffs.

More info | Contact: Ramona Chandran | Posted on: 2020-03-10

PhD in computer vision / deep learning

Topic: Semi-supervised (deep) learning for image sequences
Laboratory: IMS (Laboratoire de l’Intégration du Matériau au Système), UMR CNRS 5218, University of Bordeaux, France
Supervisors: Pr. Yannick Berthoumieu, Dr. Guillaume Bourmaud and Dr. Rémi Giraud.
Funding: 3-year PhD studentship funded by the french “Ministère de l’Enseignement supérieur, de la recherche et de l’Innovation”
Context: This thesis will seek to develop DL techniques and architectures in the specific context of image sequences (videos, time series, etc.).
Qualifications: Master degree, specialized in applied math, image computing or artificial intelligence. Solid programming skills are required (Python, C, C++), and some knowledge in deep learning frameworks (PyTorch or TensorFlow) are a significant plus. Fluency in scientific English is also very important.
Application: send a file with CV, motivation letter, transcripts, or any document likely to strengthen the application (letter of recommendation, etc.) at yannick.berthoumieu@ims-bordeaux.fr

More info | Contact: Pr. Yannick Berthoumieu | Posted on: 2020-03-10

Research Engineer II

The Visual Intelligence group is building new AI-based platforms, services and consumer experiences that reach hundreds of millions of people every day. Our products range from image and video understanding using computer vision, video stream ranking and recommendations to building new augmented reality experiences and streaming live entertainment and sports to consumer facing apps. Our team consists of innovative and enthusiastic scientists and engineers looking to revolutionize video streaming. We are looking for product-minded researchers and engineers who can help drive new features from idea through to launch.

Position responsibilities:
- Develop and support visual content moderation models for image and video.
- Design and develop lightweight and highly efficiency vision models that would run on the edge and on mobile devices.
- Design and carry out both fundamental and applied research in large-scale image and video understanding.
- Work closely with engineers to develop prototypes and transfer research to new products, new processes, and/or new business areas.
- Actively participate in the academic community and publish high quality research as part of Yahoo Research.

Position impact:
This position will be responsible for the research and the development of some of our core machine learning and computer vision models that would run on Verizon Media's content as well as Verizon's 5G/MEC use cases. Computer vision has been called out as a strategic investment area for Verizon for creating differentiating business opportunities that leverage 5G and running on the MEC.

Position opportunity:
This position will grow as a subject matter expert owning all moderation research and models, along with specific areas of expertise for models that serve Verizon customers using the MEC, which will depend on the candidate expertise.

Position requirements:
- PhD or MS in Computer Vision, Multimedia, Deep Learning, Machine Learning, AI or a related field.
- 5+ years of research or research engineering experience in computer vision, multimedia, deep learning, machine learning, and AI methodology.
- Publications in top-tier conferences and journals in related fields (e.g., CVPR, ECCV, ICCV, NeurIPS, ICML, ICLR, etc.) a plus.
- Strong algorithmic problem solving and software development skills (Python, C/C++, Java, etc.).
- Excellent communication and writing skills.

About Verizon Media:
At Verizon Media, our brands like Yahoo, TechCrunch and HuffPost help people stay informed and entertained, communicate and transact, while creating new ways for advertisers and partners to connect. With technologies like XR, AI, machine-learning, and 5G, we are transforming media for tomorrow, too. We are creators and coders, dreamers and doers creating what's next in content, advertising and technology.

More info | Contact: Paloma de Juan | Posted on: 2020-03-10

Post-doctoral position available in IMT Atlantique, Brest, France in Cognitive Robotics

A 1.5 year post-doctoral position is immediately available in the domain of assistive robotics, in the context of french project HERON.

-- Context --

Project HERON (Habitat intelligent Et RObotique d'assistance basés sur le jumeau Numérique) is part of the bilateral research program ''Chaire Maintien à Domicile (M@D)'', jointly directed by the Foundations of ENSIBS and of IMT Atlantique with a strong collaboration of the Kerpape rehabilitation centre. Its goal consists in conceiving and testing systems using new technologies allowing frail or disabled people to palliate the loss of personal autonomy and in turn, prolong their potential for continual living in their homes. Our society is increasingly confronted with this challenge as a result of its demographic change, induced by increasing ageing and birth rate decline.

-- Objectives --

In this context, the team IHSEV/RAMBO of IMT Atlantique collaborates with team MOCS of ENSIBS to develop novel assistive services, offered by service robots that operate within smart spaces/environments. The project HERON aims to develop a cyber-physical model of a system consisting of (i) the human user, (ii) the intelligent habitat and (iii) the assistive robots, on the basis of the notion of ''Digital Twin'' (DT) for each of these constituents. Establishing this dual relation between the real world and its replicas in the form of DTs will serve as reference point, on the basis of which different assistance services could be developed, allowing to monitor, diagnose and forecast the behavior of the entire system. Inspired by the exploitation of DTs in the domain of Industry of the Future and Internet-of-Things, the project HERON extends this perspective in the domain of personal assistance. Full details related to the project, candidate's profile and application procedure are available in:

https://drive.google.com/open?id=1bOZFlN7Xu0dtlC-_NtCEAldR-IXZBgOg

Panagiotis PAPADAKIS & Christophe LOHR
IMT Atlantique, Brest
France

More info | Contact: Panagiotis Papadakis | Posted on: 2020-03-10

Winthrop Professor Mohammed Bennamoun

Computer Vision & Machine Learning –Research Fellow, Department of Computer Science and Software Engineering, The University of Western Australia, Australia:

• Two year fixed-term appointment
• Salary range: Level B-C $100,374 - $129,816 per annum
• Plus 17% employer contribution to superannuation

We are looking for a creative postdoctoral research fellow with experience in computer vision and deep learning. You will join a dynamic multidisciplinary team that will contribute to new and exciting research that will benefit the multi-billion dollar Australian grain industry You will support an industry funded project involving the development of advanced computer vision and deep learning algorithms for the automatic detection, identification and evaluation of crop stress using remotely sensed multi-modal and high-dimensional data. The position will be initially for a fixed term of 2 years with the opportunity to extend. Outstanding candidates will be considered for senior positions. This call will be open until the postdoc position is filled. To get more information and apply online, please visit http://external.jobs.uwa.edu.au/cw/en/listing/
With an enviable research track record, vibrant campus and working environments, supported by the freedom to 'innovate and inspire', there is no better time to join The University of Western Australia (UWA), which is ranked amongst the top 100 universities in the world and a member of the prestigious Australian Group of Eight research-intensive universities.

More info | Contact: Mohammed Bennamoun | Posted on: 2020-03-10

Research Intern, Machine Perception and Learning (PhD)

Facebook Reality Labs (FRL) brings together a world-class, cross-discipline R&D team with the shared goal of developing the next generation of AR and VR technologies. The Surreal Vision team is looking for the next generation of scientists and engineers to tackle the most ambitious problems in machine perception at our research location in Redmond, WA. The focus of this internship project lies in formulating a new generation of end-to-end real-time 3D scene understanding systems working across novel mobile sensor design, state estimation, computer vision, reconstruction, object-tracking, human-pose-tracking and large-scale online inference and optimization.

Research Topics:
• Geometric computer vision, tracking, 3D reconstruction and SLAM systems
• Machine learning approaches to object detection, tracking and scene understanding
• Exotic sensor and computational imaging devices
• Large scale optimization and data science
• Software tools to enable totally new scales of mobile machine perception
• Full-stack AR systems and experiences for augmented and virtual reality
• Our internships are twelve (12) to twenty four (24) weeks long and we have various start dates throughout the year.

RESPONSIBILITIES
• Research, develop and prototype advanced tightly integrated hardware and software technologies in the domain of tracking, 3D reconstruction, localization, SFM, calibration automation, Machine Perception, Deep Learning, state estimation etc.
• Analyze and improve efficiency, accuracy, scalability and stability of currently deployed systems
• Design and execution of algorithms
• Prototyping, building and analysis of experimental systems
• Collaboration with and support of other researchers across various disciplines
• Communication of research agenda, progress and results

MINIMUM QUALIFICATIONS
• Currently has, or is in the process of obtaining, a PhD in the field of Computer Science, Computer Vision, Machine Learning, Robotics, Physics or related field
• Interpersonal experience: cross-group and cross-culture collaboration
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
• Must be available for 3 month to 6 month internship between January 1, 2019 and December 31, 2019
• Experience with statistical analysis of data and mathematical modeling
• Experience with developing machine learning, Bayesian filtering, information theory, 3D geometry, optimization, system building, or physics based simulation
• Experience in C++ or Python

PREFERRED QUALIFICATIONS
• Intent to return to degree-program after the completion of the internship
• Experience with SLAM systems e.g. monocular, stereo, visual-inertial or RGBD
• Experience in geometric computer vision, including tracking, visual-inertial odometry, sensor/display calibration, large-scale structure from motion or relocalization technologies
• Experience working on modern deep-learning methods for self-supervised learning, federated learning, video-understanding, GANs, reinforcement learning, etc.
• Background in optics or computational imaging
• Experience in GPU programming such as CUDA
• Broad understanding of the full machine vision pipeline from sensors to high-level algorithms
• Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as CVPR, ECCV/ICCV, BMVC, NeurIPS, ICLR, ICRA, IROS, RSS or SIGGRAPH
• Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. GitHub

More info | Contact: Chris Johnson | Posted on: 2020-03-07

Research Scientist, Computer Vision (PhD)

Facebook Reality Labs is looking for world-class research scientists with an interest in developing real-time computer vision systems to take virtual presence, input, and interaction to the next level. The focus of this role is on real-time 3D computer vision for tracking hand pose, body pose, and hand-world interactions. The successful candidate must have a background in applied mathematics, numerical optimization, or machine learning as applied in computer vision, computer graphics, or robotics. In addition, candidates are expected to be strong engineers, capable of not only implementing research ideas but also delivering them into shipping devices. They will drive cutting-edge and performance-sensitive systems that incorporate the latest innovations in deep learning and computer vision.

RESPONSIBILITIES
-Plan and execute cutting-edge research to advance hand, body, and object tracking.
-Collaborate with other researchers, software and hardware engineers, and 3D artists to develop experiments and concepts that advance the entire project.
-Contribute to real-time 3D computer vision systems deployed on consumer electronics devices.
-Mentor PhD interns and collaborate with external academic groups to advance our research goals.

MINIMUM QUALIFICATIONS
-Currently has or in the process of obtaining a PhD and/or postdoctoral assignment in the field of computer vision, machine learning, computer graphics, robotics or similar.
-5+ years experience developing software in computer vision, robotics, machine learning or computer graphics, including low-level system development and development on various platforms.
-Knowledge in 3D math and geometry, with experience in applied math such as numerical optimization and machine learning.
-Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
-Interpersonal experience: cross-group and cross-culture collaboration.

PREFERRED QUALIFICATIONS
• -3+ years experience with 3D computer vision - specifically real-time tracking or pose estimation (e.g., of objects, hands, bodies, faces), 3D reconstruction, photometric stereo, object detection, and appearance modeling.
-2+ years experience developing deep learning algorithms, such as using convolutional neural networks or recurrent neural networks.
-Proven track record of achieving significant results as demonstrated by grants, fellowships, patents, as well as first-authored publications at leading workshops or conferences such as CVPR, ECCV/ICCV, SIGGRAPH, NeurIPS, etc.

More info | Contact: Chris Johnson | Posted on: 2020-03-07

Research Intern - Interaction Tracking (PhD)

Facebook Reality Labs and Oculus are looking for exceptional interns to help us create next generation experiences in virtual and augmented reality. Join a full-stack team working on computer vision, machine learning, real-time state estimation, geometric and appearance modeling, physically-based modeling, sensor design and fusion, and human computer interaction. We are accepting applications from students interested in (but not limited to) the following areas:

- Optical tracking of hands, bodies and objects and their interactions through state estimation and machine learning
- Representation modeling (e.g. appearance, geometry) of hands, bodies and objects for fast simulation and tracking
- Physical simulation of soft contact, deformation models for grasp
- Sensor fusion (e.g. of pressure, RF, EXG, IMU) with optical tracking
- Design and fast evaluation of deep neural networks
- Interaction design for hands and bodies in virtual reality and augmented reality

Computer vision (e.g. tracking), computer graphics (e.g. appearance, geometry, physically-based modeling), robotics (state estimation) and machine learning (e.g. applied DNN design) backgrounds are particularly welcome!

Our internships are twelve (12) to twenty four (24) weeks long and we have various start dates throughout the year.

RESPONSIBILITIES
-Design and execution of algorithms in the domain of computer vision, real-time state estimation, machine learning, geometric or appearance modeling (computer graphics), sensor fusion, or HCI
-Software and hardware prototyping, system-building
-Designing user studies and experiments
-Collaboration with and support of other researchers across various disciplines
-Communication of research agenda, progress and results

MINIMUM QUALIFICATIONS
-Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Robotics, Applied Math or a related STEM field
-Excellent interpersonal skills, cross-group and cross-culture collaboration
-High levels of creativity and quick problem solving capabilities
-Demonstrated software engineering experience via an internship, work experience, or paper publications
-Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

PREFERRED QUALIFICATIONS
-Intent to return to degree-program after the completion of the internship/co-op
-Proven track record of achieving significant results as demonstrated by first-authored publications or implementation of substantial software systems
-Experience with C/C++, numerical optimization, and/or machine learning

More info | Contact: Chris Johnson | Posted on: 2020-03-07

Research Intern - Eye Tracking (PhD)

Facebook Reality Labs Redmond is looking for exceptional interns to help create the next generation of virtual and augmented reality. Our research focuses on true solutions to complex tracking problems, delivering novel technologies and algorithms fundamental to future VR and AR systems. You’ll have the unique opportunity to work with industry-leading researchers and engineers who are defining the future of VR.

Our research topics include (but are not limited to) the following areas:

-Computer vision and machine learning, with an emphasis on eyes and/or faces.

-Geometric modeling and non-linear optimization for compact representation of high-dimensional functions.

-Photometric reconstruction of eyes and faces using advanced capture and rendering techniques.

-Statistical modeling of oculomotor systems and sensor fusion algorithms.

-Eye movement prediction and perceptual control loops.

-Scene and Video analysis, Multi-modal sensor and interaction fusion, Egomotion data-analysis, Object Detection/Segmentation.

-Machine learning on 3D point clouds for shape understanding.

-Disentangled-latent representation learning for image synthesis in 2D and 3D.

-Temporal sequence learning for gaze estimation and prediction.

-Statistical machine learning for uncertainty analysis and prediction.

In particular, we welcome candidates who strive for a deep understanding of complex systems, and a strong desire to push beyond state-of-the-art. We also welcome students with a passion for working in a strongly collaborative team that spans research across algorithms, hardware design and systems prototyping.

Our team at Facebook Reality Labs offers sixteen (16) weeks long internship with flexible starting dates.

RESPONSIBILITIES
-Research, model, design, and/or build novel tracking architectures.
-Fundamental analysis and understanding of emitters, signal reflectance models from complex surfaces, and sensors that form novel tracking systems.
-Collaborate with researchers and engineers across diverse disciplines.
-Communication of research agenda, progress and results.
-Analyze large-scale temporal ego-motion data with multiple sensors to understand human-interaction in real-world.

MINIMUM QUALIFICATIONS
-Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Robotics, Applied Math, Physics or a related STEM field
-High levels of creativity and quick problem solving capabilities
-Interpersonal skills: cross-group and cross-culture collaboration
-Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

PREFERRED QUALIFICATIONS
-Intent to return to degree-program after the completion of the internship/co-op.
-Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. Github)
-Experience with C/C++/Python, numerical optimization, and/or machine learning
-Experience with basic optical systems, with an emphasis on the optics of the human eye
-Proven track record of achieving results as demonstrated in accepted papers at top computer vision and machine learning related conferences such as CVPR, ICCV, ICLR, ICML, NeurIPS, etc.

More info | Contact: Chris Johnson | Posted on: 2020-03-07

Computer Vision Research Scientist - Audio

Facebook Reality Labs brings together a world-class team of researchers, developers, and engineers to create the future of virtual and augmented reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR will ultimately change everything about how we work, play, and connect. We are developing all the technologies needed to enable breakthrough AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interface, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR and VR that are so compelling that they become an integral part of our lives. The audio team at Facebook Reality Labs is looking for experts in machine learning and computer vision. This role is focused in design, development and engineering of advanced computer vision systems that drive audio visual experiences design and synthesis in AR and VR. An ideal candidate will be passionate about development of advanced proof-of-concept demonstration platforms on one hand and about pushing the state of the art by conducting fundamental research on the other hand. The position is full-time employee (FTE) and requires a PhD in computer science, deep learning, machine learning, computer vision, computer engineering or statistics.

RESPONSIBILITIES
● Independently implement state of the art models and techniques on PyTorch, Tensorflow or other platforms.
● Independently identify, motivate, and execute on reasonable medium to large hypotheses (each with many tasks) for model improvements through data analysis, and domain knowledge, and are able to communicate your learnings effectively.
● Design, perform, and analyze online and offline experiments independently with specific and well thought-out hypotheses in mind.
● Generate reliable, correct training data with great attention to detail.
● Identify and debug common issues in training machine learning models such as overfitting/underfitting, leakage, offline/online inconsistency independently and consistently.
● Understand the model architecture used, and the consequences of this for different hypotheses tested. In general, you have a good understanding of computer vision from an applied perspective, even though you may not be up to date with the state of the art.
● Able to independently resolve most online and offline issues which affect the hypothesis testing.
● Aware of common systems considerations and modeling issues, and factor this into modeling choices.

MINIMUM QUALIFICATIONS
● PhD in the field of Deep learning, Machine Learning, Computer Vision, Computer Science, Computer Engineering or Statistics or a related field.
● Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.
● 4+ years experience with development and implementation of computer vision or deep learning algorithms.
● 3+ years experience with scientific programming languages such as Python, C++, or similar.
● Demonstrated experience in implementing and evaluating work and end-to-end prototypical learning systems.
● Interpersonal skills: cross-group and cross-culture collaboration.

PREFERRED QUALIFICATIONS
● Experience with audio signal processing, audio-visual learning or similar.
● Experience with building models on speech or acoustic datasets.
● Proven track record of achieving significant results and innovation as demonstrated by first-authored publications and patents.

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Research Intern, Audio (PhD)

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities — we're just getting started. Facebook Reality Labs brings together a world-class team of researchers, developers, and engineers to create the future of virtual and augmented reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR will ultimately change everything about how we work, play, and connect. We are developing all the technologies needed to enable breakthrough AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interface, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR and VR that are so compelling that they become an integral part of our lives. We are accepting applications from students interested in (but not limited to) the following areas: Audio Signal processing Microphone array processing Acoustics Hearing sciences Speech Psychoacoustics CPU-GPU parallelization Machine learning Numerical solvers Monte Carlo simulations Our internships are sixteen (16) to twenty four (24) weeks long and we have various start dates throughout the year.

RESPONSIBILITIES
● Design and implementation of novel algorithms to solve audio research problems
● Collaboration with and support of other researchers across various disciplines
● Communication of research agenda, progress and results

MINIMUM QUALIFICATIONS
● Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
● Interpersonal experience: cross-group and cross-culture collaboration
● Currently has, or is in the process of obtaining, a PhD degree in the field of Acoustics, Computer Science, Mechanical Engineering, Electrical Engineering or related STEM fields
● High levels of creativity and quick problem solving capabilities

PREFERRED QUALIFICATIONS
● Intent to return to degree-program after the completion of the internship/co-op
● Demonstrated software engineer experience via an internship, work experience, coding competitions, or PhD papers
● Experience with C/C++, MATLAB or CUDA

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Research Intern, Full Body Capture and Reconstruction

Facebook Reality Labs(FRL) is a world leader in the design of virtual and augmented reality systems. We are currently seeking innovative interns with a passion for technology to develop the next generation of virtual humans. The focus of our roles is on full body capture and reconstruction.

Research Topics:
* Markerless motion capture
* Dense 3D surface deformation and reconstruction
* Statistical deformation models
* Physics based animation and simulation
* Applied machine learning
* Differentiable rendering
* Point cloud representations

Our internships are twelve (12) to sixteen (16) or twenty four (24) weeks long and we have various start dates throughout the year.

RESPONSIBILITIES
● Design and execution of algorithms
● Prototyping, building and analysis of experimental systems
● Collaboration with and support of other researchers across various disciplines
● Communication of research agenda, progress and results

MINIMUM QUALIFICATIONS
● Currently has, or is in the process of obtaining, a PhD in Computer Science, Computer Vision, Machine Learning, Robotics
● Interpersonal skills: cross-group and cross-culture collaboration
● Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
● Must be available for 3 month to 6 month internship between January 1, 2020 and December 31, 2020

PREFERRED QUALIFICATIONS
● Intent to return to degree-program after the completion of the internship
● 2 or more years of experience with developing machine learning, Bayesian filtering, information theory, 3D geometry capture, non-rigid deformation, and physics based simulation
● 2 or more years of experience with C/C++, numerical optimization, and/or machine learning
● Proven track record of achieving results as demonstrated in accepted papers at top computer vision and machine learning related conferences such as CVPR, ECCV, NIPS, etc.

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Software Engineer Intern - Face/Body Tracking (PhD)

Great virtual reality technology depends on advances in computer vision and machine learning. As an intern at Facebook AR/VR, you will get an opportunity to make an impact on one of our most exciting and challenging efforts aimed at providing immersive human presence and interaction. You will apply advanced computer vision and machine learning techniques to solve problems at the forefront of virtual reality. The ideal candidate is pursuing a PhD in computer vision, machine learning, or graphics and is passionate about enhancing the user experience in virtual reality.

RESPONSIBILITIES
● Investigate, design and implement a certain concept/module/capability related to providing human presence and interaction
● Develop tools, scripts and tests to support your project
● Collaborate with and support other engineers across various disciplines
● Document and present your progress and project

MINIMUM QUALIFICATIONS
● Currently has, or is in the process of obtaining, a PhD degree in the field of computer vision, machine learning, computer graphics, or robotics
● Must be available for 12 week internship between January 1st, 2020 and December 31st, 2020
● 2+ years experience with systems building in C++
● Excellent interpersonal skills, cross-group and cross-culture collaboration
● High levels of creativity and quick problem solving capabilities
● Proven track record of achieving significant results
● Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

PREFERRED QUALIFICATIONS
● Demonstrated software engineer experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g. Github)
● Experience with articulated object modeling and tracking (e.g. hands, body), pose understanding, 3D reconstruction, face tracking, or numerical optimization
● Intent to return to degree-program after the completion of the internship/co-op

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Software Engineer Intern, Computer Vision (PhD)

Great virtual reality technology depends on advances in computer vision and machine learning. As an intern at Facebook AR/VR Oculus team, you will get an opportunity to make an impact on one of our most exciting and challenging efforts aimed at providing immersive human presence and interaction. You will apply advanced computer vision and machine learning techniques to solve problems at the forefront of virtual reality. The ideal candidate is pursuing a PhD in computer vision, machine learning, or graphics and is passionate about enhancing the user experience in virtual reality.

RESPONSIBILITIES
● Participate in cutting edge Computer Vision research and development for VR/AR/MR related topics
● Develop algorithms and software that will be part of mass-market shipping consumer products
● Cross-functional interaction with hardware, automation and product design teams at Oculus

MINIMUM QUALIFICATIONS
● Pursuing a PhD in the field of computer vision or related area
● Must be currently enrolled in a full time degree program and returning to the program after the completion of the internship
● 2+ years experience with systems building in C++
● Knowledge in computer vision, structure from motion, optimization, 3D reconstruction, machine learning, image processing, computational geometry, robotics, SLAM, tracking, or sensor fusion
● Excellent interpersonal skills, cross-group and cross-culture collaboration
● High levels of creativity and quick problem solving capabilities
● Proven track record of achieving significant results
● Able to obtain work authorization in Switzerland between January 1, 2020 and December 31, 2020

PREFERRED QUALIFICATIONS
● Demonstrated software engineer experience via an internship, work experience, coding competitions, open source contributions, or research

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Research Intern, Photorealistic Telepresence (PhD)

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities — we're just getting started.

Facebook Reality Labs (FRL) in Pittsburgh is looking for exceptional interns to help us create a revolution in virtual reality: achieving true photorealistic telepresence, where you can with anyone, anywhere, at anytime. We have made some important advances, but it will take a diverse team with a wide spectrum of skills to accomplish this future. If you have expertise in computer vision, machine learning, and computer graphics, we expect you will find the work here highly intriguing. We are looking for motivated software, electrical, and mechanical engineers; and strong math skills are always a huge plus. We publish our work at leading conferences and journals.

Come join us as we make photorealistic telepresence in VR happen!

Available projects may include, but are not limited to:
* Speech Synthesis
* Machine Learning for Raw Audio
* Distributed machine learning / deep learning
* Multi-modal Face Tracking
* High Fidelity Hand Model Reconstruction and Tracking
* Geometric Camera Calibration
* Photometric Camera Calibration
* High Fidelity Face Models from Photo Collections
* 3D Audio Reconstruction from Multiple Microphones
* CNN Acceleration for realtime tracking
* High-Precision 3D Hair Reconstruction
* Full Body Tracking from the Headset
* Realtime Markerless Motion Capture for Faces and Bodies

Our internships are twelve (12) to sixteen (16) or twenty four (24) weeks long and we have various start dates throughout the year.

RESPONSIBILITIES
● Solve real problems in enabling Photorealistic Telepresence
● Collaboration with and support of other researchers across various disciplines
● Communication of research agenda, progress, and results

MINIMUM QUALIFICATIONS
● Currently has, or is in the process of obtaining, a PhD in Audio Processing, Computer Science, Computer Vision, Computer Graphics, Robotics, Machine Learning, or related field
● Interpersonal skills: cross-group and cross-culture collaboration
● Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
● Must be available for 3 month to 6 month internship between January 1, 2020 and December 31, 2020
● Experience with solving inverse problems in imaging emphasizing modeling, algorithm development, and hardware prototyping
● Experience with scientific programming languages such as Matlab or Python

PREFERRED QUALIFICATIONS
● Intent to return to degree-program after the completion of the internship
● Experience with systems building in C++
● Experience with Machine Learning for Sequence Prediction, NLP, or Speech Synthesis
● Experience with Machine Learning for 3D Data (such as meshes, point clouds, and voxels)
● Experience with Machine Learning for Visual Synthesis
● Proven track record of achieving significant results as demonstrated by patents and first-authored publications at leading workshops or conferences such as ICCV, CVPR, NIPS, SIGGRAPH, ICASSP, or similar
● Demonstrated engineering experience via an internship, work experience, coding competitions, or widely used contributions in open source repositories (e.g., GitHub)

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Research Intern - Spatial AI (PhD)

The AR/VR team at Facebook is helping people around the world come together and connect through world-class Augmented and Virtual Reality hardware and software. We are developing the future of AR and VR, bringing products to consumers that transform entertainment and social experiences. Virtual reality’s potential to connect the world is immense—and we’re just getting started. With global departments dedicated to VR research, computer vision, haptics, social interaction, and more, AR/VR is committed to driving the state of the art forward through relentless innovation. VR’s potential to change the world is immense—and we’re just getting started.
Our Core Tech team explores, develops, and delivers new cutting-edge technologies that serve as the foundation of current and future AR/VR products. From mixed reality and human interaction to natural inputs and beyond, Core Tech is focused on taking new technologies from early concept to the product level while iterating, prototyping, and realizing the human value and new experiences they open up. Spatial AI is seeking a talented Computer Vision Engineer Intern to solve new and emerging vision problems in VR. The Spatial AI Vision team applies a range of software, computer vision and machine learning techniques to build products that enable new ways for people to connect and share experiences. Our team is addressing a variety of technical challenges in the areas of advanced optics, real-time image processing, depth sensing, SLAM, sensor fusion, 3D reconstruction and human interaction in the form of hand/face/eye tracking. We're looking for candidates who share a passion for exploring and solving complex, unsolved problems at the intersection of computer vision and VR. Open positions are based in Menlo Park and Seattle.
positions are based in Menlo Park and Seattle.

RESPONSIBILITIES
● Research, develop, and implement a certain concept/module/capability related to tracking to user in augmented and virtual reality
● Collaboration with and support of other engineers across various disciplines
● Communication of research project agenda, projects and results

MINIMUM QUALIFICATIONS
● Currently has, or is in the process of obtaining, a PhD degree in the field of Computer Vision or Robotics
● Must be available for a 12-week internship between January 1, 2020 and December 31, 2020
● 3+ years of experience with systems building in C++
● Proven track record of achieving significant results
● Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

PREFERRED QUALIFICATIONS
● Intent to return to degree-program after the completion of the internship/co-op
● Demonstrated software engineer experience via an internship, work experience, coding competitions, or PhD papers
● Experience with SLAM and visual-inertial navigation, 3D reconstruction, numerical optimization, OpenCV, mobile applications, and machine learning
● High levels of creativity and quick problem solving capabilities
● Excellent interpersonal skills, cross-group and cross-company collaboration

More info | Contact: Courtney Marshall | Posted on: 2020-03-07

Software Engineering Intern, Portal AI (PhD)

As part of the Portal AI team, you will be responsible for creating cutting-edge algorithms and technologies that can significantly enhance Facebook’s Portal product to understand visual/audio environments and interact with users. By creatively applying Deep Learning technologies to various applications and services, you will contribute to taking the user experiences on Portal to the next level. You will have opportunities to demonstrate your work on current and upcoming Portal platforms. Our internships are twelve (12) to sixteen (16) weeks long and we have various start dates throughout the year.

RESPONSIBILITIES
● Design, develop and implement novel AI algorithms for Portal for example in people detection and tracking, segmentation, or action and gesture recognition
● Contribute to cutting edge research in machine learning/computer vision that can be applied to future Portal products
● Identify areas of differentiation and innovation by leveraging new and existing audio/vision and Deep Learning algorithms
● Prototype algorithms and system applications in Python/C++/Java
● Publish the results in a top conference

MINIMUM QUALIFICATIONS
● Currently has, or is in the process of obtaining, a PhD degree in Computer Vision, Computer Science, Machine Learning or a related technical field.
● Interpersonal skills: cross-group and cross-culture collaboration
● Familiar with at least one deep learning tools and packages like pyTorch, TensorFlow, etc.
● Experience with Python or C++
● Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment

PREFERRED QUALIFICATIONS
● Intent to return to degree-program after the completion of the internship/co-op
● Publications in top-tier journals and conferences
● Experience with production machine learning projects
● Experience with On-device/CPU/GPU optimization

More info | Contact: Courtney Marshall | Posted on: 2020-03-07