OS X 10.10 – Source Code

http://opensource.apple.com/release/os-x-1010/

by beltex • 12 years ago

495 144 12 years ago

opensource.apple.com

justcommenting• 12 years ago

for a second there i was hoping to see that they had merged https://github.com/fix-macosx/

reubenmorais2• 12 years ago

Here's a diff between the 10.9 package list [0] and this one: https://gist.github.com/anonymous/014e71ac38a4776811f7

Few changes, but some interesting things pop out, like the addition of libmalloc and libpthread and the removal of memcached and securityd.

[0] http://opensource.apple.com/release/os-x-109/

pilif• 12 years ago

The removal of launchd is a bit of a bummer.

jzelinskie• 12 years ago

especially since someone had been working on porting it to FreeBSD for their Summer of Code project.

lambda• 12 years ago

Not running 10.10 at the moment; did they switch to something else, or just not release the source?

0x09• 12 years ago

I guess this puts the quiet removal of launchd from macosforge.org into perspective.

http://web.archive.org/web/20120609100559/http://launchd.mac...

Unfortunate timing since it was finally getting a working port on FreeBSD.

awalton• 12 years ago

Diff isn't the world's best way to look at this. e.g. the source for securityd was still released, it's just under a different directory now (Security-57031.1.35/securityd/).

jevinskie3• 12 years ago

Nice, I'm glad they finally released libmalloc source after they separated it from Libsystem (or was it in Libc? Eh, one of those). It was not in the 10.9 releases when the split happened. I think most of libSystem.dylib (and its sub-dylibs) are once again open source. =)

aktau2• 12 years ago

Not really, I still can't seem to find the SSE assembly versions of many functions that have been missing since OSX 10.9:

http://stackoverflow.com/questions/25505371/where-did-osxs-x...

preillyme• 12 years ago

Yeah, I'm for sure missing launchd and memcached. But I suppose they've got their reasons.

duskwuff• 12 years ago

memcached is still open source. Apple's just no longer redistributing source for it (probably because it's no longer included with the OS).

RexRollman• 12 years ago

Do they not create bootable, installable images of Darwin anymore?

voltagex_5• 12 years ago

From memory, this is the first release of the Darwin source in ages, but https://opensource.apple.com/ looks to have been updated.

http://www.puredarwin.org/ looks abandoned, and OpenDarwin disappeared long ago - http://www.applematters.com/article/opendarwin-dies-a-lonely...

NSCFType2• 12 years ago

From memory, this is the first release of the Darwin source in ages

Ages? https://opensource.apple.com/ looks like it has for a while, except for the addition of 10.10 (I grab CFLite, libclosure, libdispatch, and objc4 whenever they're made available after a release).

NSCFType2• 12 years ago

Not in a very long time. If memory serves, Apple last released a bootable image for one of the Darwin 8.x releases.

eccstartup• 12 years ago

swift is not open source?

nkozyra2• 12 years ago

Some claim it will be, though there's been nothing official from Apple yet.

bobbles• 12 years ago

im pretty sure the official comment was 'we don't know yet, but we'd like it to be if it makes sense'

DerekL• 12 years ago

Not currently. But it's a development tool, and not a part of OS X, so it wouldn't be listed here anyway. For instance, this page has Clang, GCC, Git, etc.: http://opensource.apple.com/release/developer-tools-51/

beltex• 12 years ago

https://github.com/ksm/SwiftInFlux#open-source-possibility

chrisBob• 12 years ago

For those of us who don't know what we are looking at, and just see the title of "OS X 10.10 - Source Code", is this just Darwin, or is there more here than that?

codezero2• 12 years ago

The kernel is in the xnu folder, this is a bunch of the underlying system, not just the kernel, but it's not the case that you can compile this all and get a working OS X Yosemite desktop (at least, I don't think you can but correct me if I'm wrong!)

benwaffle• 12 years ago

I think I did compile a kernel on 10.6 or 10.7

thelibrarian2• 12 years ago

My understanding (which may be out of date) is that this is the complete OS but without the GUI layer - it is the kernel, init system, shell, and user-space CLI utilities. It does not include the GUI shell (Aqua), the GUI libraries (Frameworks in OS X terminology), or GUI applications (iTunes, Mail, Safari etc.).

pwnna• 12 years ago

Does this mean if you compile this and get it to work, you can get something like XFCE or KDE running on it?

nathanvanfleet• 12 years ago

Keep in mind that there are a lot more Frameworks other than just GUI related ones that aren't present as well. They have a lot more tools missing than just the "glitter"

comex• 12 years ago

It would be more accurate to say that it's most of a fairly random subset of the OS that was made open source back in the day - there's very little of newer projects (regardless of what 'layer' of the OS they're at), including ones that replaced older ones, some old stuff is gone, and I'm not sure it ever really counted as complete.

Some examples:

- The main kernel is open source (although not 100% identical to the version in OS X), but many kernel extensions are closed source, including quite basic stuff like disk image mounting.

- In one open source kernel extension I'm interested in, IOUSBFamily, functionality has been randomly disappearing in favor of empty .cpp files. Like several of the opensource releases, it doesn't actually compile...

- A version of CoreFoundation (C level API) is available, but not the full thing. The Objective-C runtime is available, but the core Objective-C libraries have never been.

- libxpc, which is rather low-level functionality added a few releases ago, was never open sourced; launchd is gone in this release, but before that it didn't compile, thanks to missing xpc headers.

- Bootloaders: BootX from PowerPC was open source, but the x86 EFI stuff was always closed source.

- libm is gone this release. cctools may be gone. Some libSystem libraries such as malloc and pthread were separated out in a previous release, but not open sourced; they're back now, though.

Igglyboo2• 12 years ago

I think it's everything but XQuartz.

voltagex_5• 12 years ago

A great, although sad post about the state of building (booting) Darwin: http://superuser.com/a/634080

codezero2• 12 years ago

Bummed they didn't fix the bug I submitted in vfs_syscall. In fsetxattr when key values are too long it returns EPERM instead of ENAMETOOLONG as described in the man page :(

Bug is not present in setxattr: http://opensource.apple.com/source/xnu/xnu-2782.1.97/bsd/vfs...

3rd3• 12 years ago

Why is iOS only disclosed up to version 6.1.3? https://opensource.apple.com/

JohnTHaller2• 12 years ago

I believe Apple stopped releasing any source for iOS at that point. The open source projects they pull from are BSD/MIT which permits and encourages closed source usage.

colinbartlett• 12 years ago

Presuming OS X pulls from the same licensees, why do they release those revisions but not iOS?

saurik4• 12 years ago

WebCore and JavaScriptCore are LGPL, so they can't stop providing the source code for their mobile builds. I sent Apple a request for disclosure a couple days ago. In a week or so if I haven't gotten anything I will start escalating.

feld• 12 years ago

It doesn't encourage, it merely permits.

It does encourage you to upstream your changes so you don't have to hire developers to keep up with upstream's improvements and deal with merge hell.

chollida1• 12 years ago

I opened one package at random

http://opensource.apple.com/source/IOFWDVComponents/IOFWDVCo...

I see this:

#include <Carbon/Carbon.h>

//#include <Resources.h>

//#include <OSUtils.h>

//#include <Components.h>

#include "DeviceControlPriv.h"

#include "IsochronousDataHandler.h"

#include "DVVers.h"

#include <stdio.h>

#include <stdlib.h>

//#include <syslog.h>

// Debug messages

It's good to know that I'm not the only one who has commented out code in their shipping code:)

nkozyra2• 12 years ago

Trust me, you're among friends.

themartorana• 12 years ago

You have no idea. I know git is supposed to mean I can delete code without fear of losing it.

Still...

nraynaud• 12 years ago

I'm the converse, I break other rules, but I really don't commit commented code (well I have some demo code commented somewhere, but it's runnable code).

steedsofwar• 12 years ago

Commented code, yuk.

nextweek2• 12 years ago

This is bad practice, at best it shows a lack of confidence in what you've written. At worse it shows you don't understand what's going on.

Version control shows the evolution of design, if you are leaving in dead code you need to take a step back and think about the real solution.

gh02t• 12 years ago

Does anybody know what Apple uses internally as their version control setup? I did some Google searching that seems to suggest they use Git, but I'm curious if anyone knows more.

ssmoot3• 12 years ago

I've heard this so much. Usually from people who reinvent the wheel five times over.

I've never seen anyone dig through VCS history to gain a better understanding of code. And since presumably things change because the understanding evolves, I'm not even sure what the thought process is that would lead someone to do that.

You comment out code because your understanding might not be perfect, you might want the option to easily roll-back, or even have a reminder that a particular change was made. You'll remove it in the next revision or two.

So yeah. I've heard this before. It's complete and total nonsense IME.

callumprentice2• 12 years ago

I thought Carbon was already deprecated in favor of Cocoa - does that header mean it's still being used in the Yosemite?

vor_• 12 years ago

Carbon applications are deprecated, but there are C-based APIs still in use that fall under that umbrella term, such as Keychain Services.

10098• 12 years ago

Exterminate it with a flamethrower

jevinskie3• 12 years ago

This inspires me to update my script that converted opensource.apple.com into Github repos [0] (even creating the repo using the Github API). It needed more work because some of the Apple source releases are messed up and include another copy of the source tree in a directory at the root of a tarball!

I asked Github if it was OK to upload the tens of gigabytes of source that the entirety of opensource.apple.com is and I got a "Sure, why not?" response. =)

I think the last time I updated these repos was around 10.7 or 10.8

[0] https://github.com/Apple-FOSS-Mirror/

Edit: I was always wondering how I could manipulate git such that anyone could checkout my scripts and create identical git repos (same commit hashes and all) with a single command. I am somewhat hesitant to update the repos now because it would involve rewriting old commits since I haven't solved this problem yet.

voltagex_5• 12 years ago

That's a brilliant idea. Couldn't you test a newer version of your script against a new branch?

jevinskie3• 12 years ago

Yeah... once I find it on my old backups. =) Ironically, my script that produces git repos was not itself version controlled. Lesson learned (for the umpteenth time). I wasn't comfortable putting it public due to sloppiness and I didn't yet have my own GitLab server. I now have the latter and am motivated to fix the former (put the script itself on Github). =)

malkia• 12 years ago

Yup. Great idea. Along with "github-backup" like tool (I use this one - https://github.com/joeyh/github-backup) then I could spend days browsing and reading :)

aktau2• 12 years ago

For those interested, a great github repo with the OSX Libc is here:

https://github.com/aosm/Libc

Very easy to switch between OSX releases with the tags.

ahmett• 12 years ago

And the good old shellshocked bash version 3.2 http://opensource.apple.com/source/bash/bash-94.1.2/version....

0x03• 12 years ago

You have to look for the vulnerable code, not just the version string. Supposedly it has already been patched.

ctpide• 12 years ago

a patch was released for OS X versions below 10.10 only, so I would assume it should be applied to OS X 10.10: http://support.apple.com/kb/HT6495

jammi• 12 years ago

That's not shipping or has patches added:

---------

rutina:~/git/bashcheck@master$ uname -a

Darwin rutina.local 14.0.0 Darwin Kernel Version 14.0.0: Fri Sep 19 00:26:44 PDT 2014; root:xnu-2782.1.97~2/RELEASE_X86_64 x86_64

rutina:~/git/bashcheck@master$ ./bashcheck

Testing /bin/bash ...

Bash version 3.2.53(1)-release

Variable function parser pre/suffixed [__BASH_FUNC<..>(), apple], bugs not exploitable

Not vulnerable to CVE-2014-6271 (original shellshock)

Not vulnerable to CVE-2014-7169 (taviso bug)

Found non-exploitable CVE-2014-7186 (redir_stack bug)

Test for CVE-2014-7187 not reliable without address sanitizer

Found non-exploitable CVE-2014-6277 (lcamtuf bug #1)

Not vulnerable to CVE-2014-6278 (lcamtuf bug #2)

bingeboy• 12 years ago

This is a good step into making Star Trek law the real law.

voltagex_5• 12 years ago

Any idea what's up with the cert on https://opensource.apple.com/?

cpach2• 12 years ago

It works fine for me. AFAICT the cert they use is okey.

[Fingerprint: 92 D3 F3 46 0E BA A5 FE D5 5E C8 AE 19 59 82 57 85 FE AE 88 A5 9D F7 BE FC 47 89 38 5F BC 4A E9 (SHA-256)]

tkubacki• 12 years ago

in recent years even MS is releasing more meaningful open source code than Apple (eg. asp.net vnext, PCL) or I'm missing something

oblio• 12 years ago

They've also added support for Docker, contributed code to Linux and are including a package manager in Windows 10. The world is turning upside down :)

lolo_• 12 years ago

Not sure they're releasing any OS code publicly though :-) internals still have to be somewhat guessed/reverse engineered at.

Someone2• 12 years ago

There are strings attached, but it is not that hard to get access to the Windows source code: http://www.microsoft.com/en-us/sharedsource/default.aspx

adamnemecek• 12 years ago

The procmail source is something else https://opensource.apple.com/source/procmail/procmail-14/pro...

astrodust• 12 years ago

For a real head trip, read Sendmail's.

arunc• 12 years ago

What version control does Apple use? Is this the same that is being hosted in the linking site as well?

chicofarm• 12 years ago

does this mean we can compile Yosemite from the code here and install it on a modern Mac?

Or is this just the Darwin kernel code?

Are the aqua/user interface layer also included here?

Any CONTEXT related to this source code would be greatly appropriated.

mbel• 12 years ago

It seems those are only the free/open source components, that are used by OS X.

72deluxe• 12 years ago

Vast portions of code that makes it usable are missing; as someone above stated, Aqua is missing as well as core items like disk image mounting etc.

I tried many years ago to use Darwin in the "haha I can run Mac OSX but not actually buy a Mac" sort of idea - it was an exercise in hard work (as I hadn't a clue what I was doing) and what I did managed to get to boot wasn't massively useful for "real" work (a CLI with no windowing layer) like development etc. or anything you do day to day.

Quite interesting nonetheless, but not massively useful.

jarin• 12 years ago

It's not intended to be used standalone, it's there for other OSS developers to be able to use.

locomoco• 12 years ago

Now will someone figure out a terminal command to turn off the MacBook Pro display for Yosemite?

Like the following: http://osxdaily.com/2011/09/14/disable-the-internal-screen-o...

dangayle2• 12 years ago

Does anyone know what they're using Twisted for?

jdub• 12 years ago

A bunch of the OS X Server stuff, including calendars, feeds, etc.

dangayle2• 12 years ago

Really. I'll have to dig into it to see how they're using it.

jiyinyiyong• 12 years ago

Hi Ubuntu! How do you think about this?

amaks• 12 years ago

Just by glancing over the code overall looks like a poorly structured and inconsistent code, lacking centralized coding guidelines or practices. Pretty scary for a shipping product to have code like this.

iunk• 12 years ago

and they fixed a few Integer overflows - int size = inCapacity * sizeof(dictEntry); + if (inCapacity > (UINT_MAX / sizeof(dictEntry))) + return false;

+ unsigned int size = inCapacity * sizeof(dictEntry);

OS X 10.10 – Source Code

Related Stories