Show HN: A PHP parser written in PHP

by nikic • 14 years ago

77 39 14 years ago

bradt2• 14 years ago

This would be a great way to create a PHP-based templating system that just uses a subset of PHP as syntax. Would be very fast.

leftnode• 14 years ago

PHP already has this built into it - http://us.php.net/alternative%20syntax - just use it.

ceejayoz• 14 years ago

That's not a subset, that's just a different syntax.

If you're making a template language for use in a SaaS system, you'd want to perhaps allow echo, but not file_put_contents.

kemo2• 14 years ago

Lithiums' templating "engine" does something like that, using the tokenizer.

wadetandy• 14 years ago

There is a php port of the extremely awesome and popular HAML templating system from Ruby, phphaml: http://phphaml.sourceforge.net/

fooyc• 14 years ago

There is also a modern php implementation of HAML at https://github.com/arnaud-lb/MtHaml

I believe it's much faster too.

bithive123• 14 years ago

This must be a stupid question because I've noticed that it's commonplace, but why do PHP-based projects try to build templating systems in PHP? Do they not realize that the original use case for PHP was to turn plain HTML files into dynamic templates?

I saw this in Horde, the other day; mixed in with the usual PHP tags they had added their own XML tags for doing "if/else" type things in the template. What is the purpose of that?

geon• 14 years ago

I believe it's an attempt to assure there is no logic in the template code.

...which I think is retarded and anal, since the important part is separation of business logic and presentation. There is bound to be some level of display logic, which is why most template languages have loops and conditionals. But if you are going that far, why not just use PHP? It is arguably a very good template language.

jasonlotito• 14 years ago

How does this compare to PHP_CodeSniffer, and it's Tokenizer? You're both using token_get_all under the hood, but PHPCS has support for CSS/JS as well.

nikic• 14 years ago

PHP_CodeSniffer - as you already say - works with the source code at a token level. This is necessary, because it looks at the precise formatting of the code (like whitespace usage).

The parser is more for analyzers that are not interested in the precise formatting of the code, but want to look at the code from a higher level perspective.

For example, if you want to do control flow analysis and type inference working directly on the tokens would be really hard. An Abstract Syntax Tree makes this kind of work much easier, as you don't have to think about the tiny details of the language.

drewdrewdrew• 14 years ago

PHP inception brain explode

mgkimsal• 14 years ago

One of the interesting things about Groovy for me has been the runtime AST transformation stuff - annotating something as @singleton, then having the engine make it in to a singleton at compile time, etc.

Certainly this project doesn't get us there immediately, but might give some neat ideas for future PHP versions to incorporate.

aarondf2• 14 years ago

This is not a snide comment, I'm truly curious. What is the point of "An [x] parser/interpreter/compiler written in [x]." I've seen one now for JS and this one for PHP. I lean more toward the sponge learning [1] side of HN, so forgive me if this is super obvious.

[1] http://alexrosen.com/blog/2011/05/sponge-learning/

edit: grammar.

EmielMols• 14 years ago

For instance to allow meta-programming (programming code executed at compile time) in the same language as is being interpreted/compiled.

But more formally, a self-hosting compiler says stuff about the language per se, see also http://en.wikipedia.org/wiki/Bootstrapping_(compilers).

aarondf2• 14 years ago

Thanks for the answer and the link. I'm still trying to wrap my head around the chicken/egg problem, but that may take a little while.

Zak• 14 years ago

a self-hosting compiler says stuff about the language per se

That it's Turing-complete and can write to a file? I think all it really says is that somebody was hard-headed enough to do it.

jacquesm• 14 years ago

Line one in tfa: "It's purpose is to simplify static code analysis and manipulation."

mfonda2• 14 years ago

The benefit is that you can use it to transform PHP code into an abstract syntax tree [1]. This allows you to do some really cool things like static analysis, code transformation, preprocessing, etc. in a convenient way.

The fact that it is written in PHP is nice because it allows you to use it in existing PHP projects in an environment you are already familiar with. I think the fact that it is written in PHP is less important than the fact that it can be used in PHP (e.g. it would be equally useful as a PHP extension written in C).

[1] http://en.wikipedia.org/wiki/Abstract_syntax_tree

exim• 14 years ago

It doesn't necessary apply to this specific posting. But in general, as with many open source projects out there, the point is in increasing author's visibility on the net and assisting author's CV in finding a job.

And there is nothing bad with this. It is just that many authors don't want to articulate on this and are trying to come up with some artificial rationales.

mbetter• 14 years ago

As far as I'm concerned, "just for the hell of it" is the most noble of all rationales when it comes to stuff like this.

wopsky• 14 years ago

Yo dog...

icheishvili2• 14 years ago

It seems like you could have saved yourself quite a bit of parsing/lexing work if you had used the parser that ships with PHP:

http://us3.php.net/manual/en/function.token-get-all.php http://us3.php.net/manual/en/function.token-name.php

Very cool nonetheless.

mfonda2• 14 years ago

They are very different things. token_get_all just tokenizes the code, but this tool parses PHP code into an AST. If you look at the source of this project, you'll notice that it does indeed use token_get_all to handle the lexing.

icheishvili2• 14 years ago

I just went and read Lexer.php to see what you mean. Never mind on my previous comment :)

Well done with the project--I have a use case for it regarding enforcing PHP style guide @ $work.

dawsdesign• 14 years ago

<?php eval($codeBase); ?>

nazar• 14 years ago

Can it compile itself then?

cfdrake• 14 years ago

It's only a parser - it just transforms plain source code into an abstract syntax tree representation. However, if you wanted to, you could use this tree for a variety of things - including translating and generating compiled code.

alexpak• 14 years ago

It's not a compiler, just a syntactic parser.

amosrobinson• 14 years ago

Cool... Now define your Node datatype in Haskell deriving Show & Read, and pretty-print to that. Then you can (easier) do some interesting analysis and transforms!

Show HN: A PHP parser written in PHP

Related Stories