Software Engineer, Trust & Safety Job at Gamma, San Francisco, CA

  • Gamma
  • San Francisco, CA

Job Description

Why this role matters now

AI has dramatically lowered the barrier for bad actors. Generating convincing phishing pages, spinning up realistic-looking fraudulent accounts, and producing abusive content at scale no longer requires specialized skill—a motivated attacker with access to widely available models can do it. The volume and sophistication of platform abuse is increasing faster than traditional approaches can keep up with.

At the same time, AI is transforming what's possible on the defensive side. A small, sharp T&S team equipped with frontier models can now build detection, triage, and response systems that would have required a team five times the size just a couple of years ago. AI-assisted content scanning, automated investigation workflows, and intelligent alert prioritization mean that a lean team can protect millions of users—if they build the right infrastructure.

About the role

Gamma is tackling one of the most critical challenges for any fast-growing AI platform: keeping millions of users safe while preserving the creative freedom that makes the product magical. As a Trust & Safety Engineer, you'll architect the systems that protect our platform from phishing, abuse, fraud, and malicious content, all while ensuring Gamma stays fast, reliable, and delightful to use.

You'll join a small, high-impact team building the foundation for trust at scale. You'll design infrastructure that serves millions, ship improvements daily, and build the internal tools that let our support teams act quickly on threats. You'll collaborate across engineering, product, and design to define how Gamma approaches safety for the long term.

Our team has a strong in-office culture and works in person 4–5 days per week in San Francisco. We love working together to stay creative and connected, with flexibility to work from home when focus matters most.

What you'll do

  • Own detection and prevention systems for fraud, abuse, spam, and malicious content across millions of daily users

  • Design and build scalable trust infrastructure including rate limiting, content scanning, anomaly detection, and account security

  • Build tools that empower internal support teams to investigate and act on suspicious or malicious activity

  • Investigate and resolve complex security incidents with limited context

  • Partner with engineering and product to balance security with user experience

  • Shape Gamma's long-term trust and safety strategy and technical roadmap

  • Leverage AI/LLM-based detection to stay ahead of AI-generated abuse—phishing, fraud, and malicious content that's increasingly indistinguishable from legitimate activity

  • Build automated triage and investigation workflows that let a small team operate at the scale of a much larger one

What you'll bring

  • 5+ years as a software engineer with a focus on abuse, spam, or fraud prevention

  • Strong systems thinking and experience building highly available web APIs, with proficiency in at least one programming language and comfort working across a modern web stack

  • Hands-on experience implementing trust features like rate limiting, content detection, and fraud prevention

  • Experience with event streaming systems (Redis, Kafka, or similar)

  • Passion for security, user protection, and solving problems at scale

Nice to have

  • Experience with AI/LLMs for content moderation, or familiarity with TypeScript, Prisma, Apollo GraphQL, or AWS

  • Experience building AI-assisted moderation pipelines or using frontier models for automated abuse detection and response

  • Familiarity with the evolving AI threat landscape—how generative models are being used for phishing, social engineering, and content abuse at scale

Compensation range:

The base salary for this full-time position, which spans multiple internal levels depending on qualifications, ranges between $180K - $310K plus benefits & equity.

Final offer amounts are determined by multiple factors, including but not limited to experience and expertise in the requirements listed above.

If you're interested in this role but you don't meet every requirement, we encourage you to apply anyway! We're always excited about meeting great people.

Job Tags

Full time, Work at office, Work from home

Similar Jobs

Howard EcoWorks

Nursery Assistant Job at Howard EcoWorks

 ...it. We are a growing, mission-driven team that cares about both our ecosystems and the people working to restore them. Volunteer Nursery Assistant Role : This volunteer role supports the Seeds of Change Native Plant Nursery at Holly Hills, Howard EcoWorks' 16-acre... 

Roamarae Global Travel

Remote Travel Agent Job at Roamarae Global Travel

Position OverviewAre you passionate about travel and helping others create unforgettable experiences? We are seeking Remote Travel Agents to assist clients in planning vacations,...  ...communication skillsComfortable using computers and online toolsSelf-motivated and organizedPositive... 

CompHealth

Physician (MD/DO) - Ophthalmology in Prescott, AZ Job at CompHealth

 ...Doctor of Medicine | Ophthalmology Location: Prescott, AZ Employer: CompHealth Pay: Competitive weekly pay (inquire for details) Start Date: ASAP About the Position Prescott, AZ, offers physicians a desirable blend of professional opportunity... 

Excel Hotel Group

Houseperson Job at Excel Hotel Group

 ...Housekeeping Houseperson The Housekeeping Houseperson (day or night shift) is responsible for cleaning and maintaining various public areas inside the hotel and outside of the hotel, delivering amenities and requested items to guests, cleaning guest rooms when specially... 

Danos

Plant Operator Job at Danos

 ...Overview We are seeking Plant Operators to support operations at a facility in Hobbs, NM. This role is responsible for monitoring and...  ...school diploma or GED equivalent required. ~1+ yrs. Oil and Gas experience required. ~ Basic understanding of plant equipment...